Issue 2026-11-14 · Industry · 开源 · 研究

Community debate: what happens as open models balloon past 100B

A LocalLLaMA poster warns that models from Qwen, Gemma, NVIDIA and others are growing from ~100B to 300B+ parameters, possibly 500B, no longer fitting 128GB devices. Proposed workarounds are distillation and 1-bit/2-bit/ternary low-bit models, though few such releases exist today.

r/LocalLLaMA2 d ago
Read original ↗