Qwen Flash Next
5 storiesQwen Flash Next is a model in Alibaba's Qwen family, often run locally through community GGUF quantizations. Recent coverage centers on local deployment: one user ran ISTA DASLab's 3.5 BPW quant on 8GB of VRAM at 262K context with about 70 T/s prefill and 8 T/s generation, llama.cpp merged MTP support and a PR (#29825) halved indexer score memory, while another user found it less reliable than Qwen 27B on long-term agent tasks.
Related topics
Hy4 flash is positioned as the most cost-effective Hy model: 224B total parameters (including 64B Engram), only 12B active per token, native multimodality, a 1M-token context window and notably lower API pricing. The poster says its specs are near Qwen-Flash-Next and it may run on moderately good machines once released.
A user demonstrated running ISTA DASLab's 3.5 BPW Qwen-Flash-Next Coder quant on 8GB VRAM plus 24GB RAM, reaching 262K context with about 70 T/s prefill and 8 T/s generation via MoE offloading and disk n-gram. Half the experts are pruned, giving an effective 1.89 bits per parameter while retained weights stay at 3.5 BPW.
A Reddit user reports that Qwen Flash Next at iq4_xs follows instructions less reliably and hallucinates more than Qwen 27B while using far fewer tokens. It excels at one-shot and benchmark tasks, and did not loop on Strata, but felt weaker for long-term agentic assistant work.
A llama.cpp pull request (#29825) halves the indexer score memory, reducing VRAM usage for Qwen Flash Next.
A pull request adding MTP support for Qwen4Exp was merged into llama.cpp after 17 hours of work, enabling MTP with Qwen Flash Next. Corresponding GGUF quantizations have been published on Hugging Face.
That is everything