Developer Runs Qwen3.5 LLMs on Cheap FPGA Mining Hardware

A developer used ~$280 SQRL FK33 ex-mining FPGAs, with Claude assisting the RTL work, to run Qwen3.5-9B INT4 inference. Two cards at 75MHz produced ~3.2 tok/s generation, dropping to ~2.4 tok/s at longer context, with layer-by-layer validation against llama.cpp.

• Transformers now runs llama.cpp quants2026-09-22
• Open-source openTPU shows AI designing its own inference hardware2026-10-06
• llama.cpp v0.6.0 Released With MTP Decoding2026-10-05
• Bilibili Releases Index-Translate Multilingual Model Family2026-10-05
• llama.cpp Outperforms Alternative Engine on Long-Form Reasoning2026-10-04