Issue 2026-11-05 · Industry · 开源 · 研究
Delta Inference Engine v0.93 boosts local DeepSeek-V4.1 runs
Delta Inference Engine v0.93 supports 64–192GB RAM; the Unsloth IQ2 quant of DeepSeek-V4.1-Flash runs at 41 tok/s on one RTX 3090 with 192GB RAM, first token about 40% sooner, scoring 57/99 versus 59 for the full model. It adds Unsloth quants, EXL3 and basic multi-GPU support.
Read original ↗