Issue 2026-10-22 · Industry · 开源 · 模型发布 · 研究

User runs 748B DeepSeek-V4.1-Flash on a €2k PC

A user ran the 748B-parameter DeepSeek-V4.1-Flash-1017 at 7.2 tok/s on a used ~€2,000 PC (RTX 3090, 128GB DDR4, i9-9900X) using a 1-bit quant and llama.cpp. A 110GB Engram table stays on NVMe and is read on demand, letting it fit. The output contained a physics error and has little practical use, the user said; Qwen models work better on the setup.

r/LocalLLaMA33 h ago
Read original ↗