TKintegers K5 tops FP8 baseline in ternary inference

A developer released TKintegers, a balanced-ternary weight representation with GPU inference kernels. On Qwen2.5-0.5B-Instruct, K5 reached 3,402.85 tokens/s prefill and 26.75 tokens/s decode on an NVIDIA L4 lacking native K5 instructions, 3.21x and 3.10x the TorchAO FP8 baseline. The author noted the FP16 control was faster and results are limited to this setup.

• User Buys Two RTX 3090s for €1,700, Seeks Three-GPU LLM Setup2026-10-31
• Apple overtakes Nvidia as world's most valuable company2026-10-31
• Nvidia shares fall as AI cost concerns mount2026-10-30
• Experts debate whether the economy relies too much on AI2026-10-30
• Developer builds Halloween haunted house with NVIDIA Nemotron models2026-10-30