Offload most of Qwen3.8 KV cache to RAM

A vLLM user shared on r/LocalLLaMA a method to keep most of Qwen3.8-Flash-Next's KV cache in system RAM while using a barely-fitting VRAM quant, achieving 1M context on 3×3090 GPUs with ~80 tok/s at short context, ~60 tok/s at long context, and 3,701 tok/s at a 248k prefill; patches and the model are available on their Hugging Face page.

• Swift‑Qwen3.8‑27B Cuts Overthinking Tokens2026-09-15
• Running Qwen3.8-Flash-Next on 12GB VRAM2026-09-15
• Muse-glimmer-30b outperforms on creative benchmarks2026-09-11
• Terminal Bench v4 ranks GLM-5.3 top2026-09-11
• Qwen3.8-27B Tuned for Humanlike Chat2026-09-11