Qwen3.8 27B IQ3_XXS vs Bonsai Ternary PQ2 quantization test

A user benchmarked Qwen3.8 27B IQ3_XXS (10.18GiB) against Bonsai Ternary PQ2 (6.42GiB) on the same 16GB VRAM setup. Both completed 4/4 tasks, but Qwen ran 3.02x faster and used 3.10x fewer output tokens; Bonsai was slower with slightly worse results.

• Qwen3.8 runs locally at 51 t/s on 12GB laptop GPU2026-09-30
• llama.cpp merges Gemma 4 graph optimizations, boosting prompt processing for E2B and E4B2026-11-04
• llama.cpp Community Shares Performance Data for Specific Quant and Hardware Combo2026-11-04
• 64GB no longer a dead zone for local AI agents2026-11-01
• Developer Measures Output Damage From Engine Speed Flags2026-11-01