Qwen3-0.6B

3 stories

Qwen3-0.6B is the roughly 0.6B-parameter small model in Alibaba's Qwen3 family, often used for local and low-resource experiments. Recent community work converted it into a Mixture-of-Experts model with GGUF releases, trading some quality for faster generation; the University of Waterloo's ProgramAsWeights uses it as a frozen interpreter for generated LoRA programs; and a developer ran it in Q4_K_M via llama.cpp on a 2017 Galaxy Note 8 to drive desktop Chrome.

Related topics

Community converts Qwen3-0.6B into MoE model

A developer converted Qwen3-0.6B into a Mixture-of-Experts model and released GGUF versions. Lacking Qwen3's shared expert, quality dropped; a pseudo-shared expert recovered some of it. MoE perplexity and task scores were worse than dense, but generation speed rose sharply.

r/LocalLLaMA ·
That is everything