Community Proposes New IQ2_K to IQ6_K Quantization Types

The LocalLLaMA community is discussing new llama.cpp quantization types IQ2_K, IQ3_K, IQ4_K, IQ5_K and IQ6_K. File sizes match Q-quants and KLD improves substantially, but performance drops slightly and creating IQ quants is slow. Test numbers cover only a single model.

• Eagle-4 Released: Faster than DFlash2 & DSpark2026-10-21
• AnyLanguageModel 1.0 ships for local models on Apple platforms2026-10-20
• llama server default port changes from 8080 to 99312026-10-20
• Cohere says llama.cpp now supports all its latest model architectures2026-10-19
• Ling 3.1 Flash 560B MoE deployed across four DGX Sparks via llama.cpp2026-10-18