Issue 2026-11-08 · Industry · 开源 · 模型发布 · 研究

llama-modchip runs 284B DeepSeek on 64GB RAM, no GPU

llama-modchip runs 284B DeepSeek on 64GB RAM, no GPU

Open-source project llama-modchip released v2.4.0, claiming 284B DeepSeek-V4-Flash can run entirely in RAM on a 64GB desktop or server with zero GPUs, using a 56.56 GiB checkpoint. It reports 44.36 tok/s prefill and 9.1-14.7 tok/s generation at 256K context, pitching CPU-only MoE inference for local workstations.

Hacker News7 h ago
Read original ↗