Qwen 3.8 Flash runs at ~21 tok/s on RTX 3060

A developer reports running a 68GB quantized Qwen 3.8 Flash Next MoE at about 21 tok/s on an RTX 3060 12GB with 16GB RAM, using expert-routing prediction to speed CPU/GPU offload with no gate pruning and bit-exact output. Warm cache reaches 24+ tok/s, versus roughly 1.4-2.1 tok/s with stock llama.cpp.

• Logit penalty on Qwen models improves math accuracy2026-09-27
• Benchmark: ThinkingCap vs Swift vs Qwen 3.8-27B2026-09-25
• Yandex Releases 80B AliceAI Foundation Model2026-09-22
• Qwen 27B runs autonomously for 3 weeks on one 30902026-09-21
• Local LLM community glimpses a golden era2026-09-13