Issue 2026-10-23 · Industry · 开源 · 模型发布

Community converts Qwen3-0.6B into MoE model

A developer converted Qwen3-0.6B into a Mixture-of-Experts model and released GGUF versions. Lacking Qwen3's shared expert, quality dropped; a pseudo-shared expert recovered some of it. MoE perplexity and task scores were worse than dense, but generation speed rose sharply.

r/LocalLLaMA9 d ago
Read original ↗