Issue 2026-11-14 · Industry · 开源 · 应用
Developer runs Qwen3.5-9B offline on a stock PS4
The open-source garlic-llm project runs Qwen3.5-9B offline on a stock PS4 GPU at 31–39 tok/s. Speculative decoding with the model's built-in MTP head lifted speed from 22 tok/s, and weights were repacked to custom 4- and 3-bit formats to fit about 4.5 GiB.
Read original ↗