Issue 2026-11-12 · Industry · 研究 · 开源

Optimizer enables low-VRAM LLM training on gaming GPUs

An AI researcher released an optimizer cutting per-weight training memory from AdamW's ~16 bytes to 1 byte or less, enabling training a 27B model on a single 24GB RTX 3090 and a 23B model on a 16GB GPU. The quantized Qwen 27B scores 0.895 on GSM8K, matching full precision, but 0.84 vs 0.93 on HumanEval, running at ~2-3 tok/s on a 12GB GPU.

r/LocalLLaMA5 d ago
Read original ↗