The A.I. Daily
Developer runs Qwen 3.8 Flash Next on an RTX 3060 at 22 tok/s
A developer released Betelgeuse, a llama.cpp fork, that runs a 68GB quantized Qwen 3.8 Flash Next MoE on a consumer PC with an RTX 3060 12GB and 16GB DDR4 RAM at 22 tok/s sustained, spiking to 48 tok/s, with no gate pruning and 100% bit-exact output. Stock llama.cpp managed only about 1.47 tok/s on the same setup.