Issue 2026-10-27 · Industry · 开源 · 芯片 · 研究

Qwen3.8-Flash-Next hits 184 tok/s on one RTX 6000 Pro

Qwen3.8-Flash-Next hits 184 tok/s on one RTX 6000 Pro

Mesh Applied released an NVFP4-quantized Qwen3.8-27B-NInfer model, claiming 184 tok/s on a single RTX 6000 Pro. The team argues open models already suffice for about 98% of real AI tasks, so the bottleneck is running them often and fast, and it optimizes quantization and kernels around time per task.

Hacker News5 d ago
Read original ↗