DeepSeek-V4.1-Flash

12 stories

DeepSeek-V4.1-Flash is a large mixture-of-experts model from DeepSeek with roughly 748B total parameters, including a 552B core, a ~197B Engram table and a vision encoder. Recent coverage focuses on running and evaluating it: a user ran it at 7.2 tok/s on a ~€2,000 used PC via a 1-bit quant and llama.cpp, DeepSeek open-sourced the DeepInfer inference engine with support for it, and it scored 5/5 in a coding test on a 16GB GPU.

Related topics

User runs 748B DeepSeek-V4.1-Flash on a €2k PC

A user ran the 748B-parameter DeepSeek-V4.1-Flash-1017 at 7.2 tok/s on a used ~€2,000 PC (RTX 3090, 128GB DDR4, i9-9900X) using a 1-bit quant and llama.cpp. A 110GB Engram table stays on NVMe and is read on demand, letting it fit. The output contained a physics error and has little practical use, the user said; Qwen models work better on the setup.

r/LocalLLaMA ·

DeepSeek open-sources its DeepInfer inference engine

DeepSeek has open-sourced DeepInfer, the high-performance inference framework behind its large-scale production services, with this release focused on offline inference. It supports DeepSeek-V4.1-Flash, offers parallelism such as attention DP and MoE EP with EPLB, optimized kernels including FlashMLA and DeepGEMM, and DSpark draft-token decoding with confidence-scheduled verification.

Hacker News ·

Jev calibration benchmark: LLMs beat humans yet know when they're right

Jev Benchmarks published calibration results: its training method is called Reinforcement Learning for Calibrated Decisions, yet its calibration gap trails Gemini 3.8 Flash, DeepSeek V4.1 Flash and GLM-5.3. Jev holds 95% accuracy and decides alone on 86% of yes/no items, more than those models, showing worse calibration but better awareness of when it is right.

r/MachineLearning ·

Hope for KVCache + Engram in Upcoming Models

A Reddit post urges applying DeepSeek-V4.1-Flash’s KVCache and Engram ideas to medium/large models so 30B-class models can run on GPUs in Q8/Q4. The post gives approximate VRAM and Engram estimates, suggests Engram may be ~1/3–1/2 of model size (10–15 GB for 30B), and argues 32GB VRAM should suffice for many optimized models.

r/LocalLLaMA ·

Deepseek V4.1 Flash is 748B total/552B base

Inspection of the safetensors shows Deepseek V4.1 Flash’s main model is about 551.566B parameters (40 layers), with FFN experts totaling 543.582B and other parts 7.984B; additionally an engram of ~196.929B, DSpark/MTP ~14.225B and a vision encoder ~0.485B, summing to roughly 748B. Other reported sizes (e.g., 485B, 522B) stem from differing counting methods or misreads.

r/LocalLLaMA ·
That is everything