Issue 2026-11-05 · Industry · 开源 · 研究

Delta Inference Engine v0.93 boosts local DeepSeek-V4.1 runs

Delta Inference Engine v0.93 supports 64–192GB RAM; the Unsloth IQ2 quant of DeepSeek-V4.1-Flash runs at 41 tok/s on one RTX 3090 with 192GB RAM, first token about 40% sooner, scoring 57/99 versus 59 for the full model. It adds Unsloth quants, EXL3 and basic multi-GPU support.

r/LocalLLaMA13 h ago
Read original ↗