Issue 2026-10-23 · Industry · 开源 · 模型发布
Community converts Qwen3-0.6B into MoE model
A developer converted Qwen3-0.6B into a Mixture-of-Experts model and released GGUF versions. Lacking Qwen3's shared expert, quality dropped; a pseudo-shared expert recovered some of it. MoE perplexity and task scores were worse than dense, but generation speed rose sharply.
Read original ↗Topics:Qwen3-0.6B