Issue 2026-11-01 · Industry · 开源 · 芯片 · 应用

Single RTX 3090 Ti achieves high-speed inference with DeepSeek and Qwen models

A user reports running DeepSeek-V4.1-Flash-1017 and Qwen3.8-Flash-Next on six-year-old hardware (RTX 3090 Ti, 128GB RAM), achieving about 35 tok/s and 138 tok/s decode speeds respectively, with an open-source tool unlocking GPU throttles.

r/LocalLLaMA5 d ago
Read original ↗