Issue 2026-11-15 · Industry · 开源 · 模型发布

Basalt 0.4.0 adds Qwen 3.8 27B with fast inference

Open-source project Basalt released 0.4.0, adding its first dense model, Qwen 3.8 27B; on a single 5090 it reaches up to about 770 tok/s structured output, 262 tok/s chat and 12,000 tok/s prefill at 4k, with 92.8% top-1 agreement versus BF16 and up to 262K context.

r/LocalLLaMA21 h ago
Read original ↗