Qwen3.8-27B

5 stories

Qwen3.8-27B is a 27B-parameter large language model. Recent coverage highlights a developer fine-tuning it with 125,217 obfuscated human-to-human messages and publishing a LoRA and demo on Hugging Face that makes replies shorter and more conversational; Terminal Bench v4 showed it as the only smaller model with notable results, while Muse-glimmer-30b outperformed it on creative writing benchmarks.

Related topics

Offload most of Qwen3.8 KV cache to RAM

A vLLM user shared on r/LocalLLaMA a method to keep most of Qwen3.8-Flash-Next's KV cache in system RAM while using a barely-fitting VRAM quant, achieving 1M context on 3×3090 GPUs with ~80 tok/s at short context, ~60 tok/s at long context, and 3,701 tok/s at a 248k prefill; patches and the model are available on their Hugging Face page.

r/LocalLLaMA · · Details
That is everything