Developer runs Qwen3.5-9B offline on a stock PS4
The open-source garlic-llm project runs Qwen3.5-9B offline on a stock PS4 GPU at 31–39 tok/s. Speculative decoding with the model's built-in MTP head lifted speed from 22 tok/s, and weights were repacked to custom 4- and 3-bit formats to fit about 4.5 GiB.