llama.cpp v0.6.0 Released With MTP Decoding
According to a Reddit post on r/LocalLLaMA, llama.cpp released version 0.6.0, adding MTP speculative decoding for Qwen4Exp along with many other updates.
Every Qwen4Exp story collected by The AI Daily, 2 so far, newest first, refreshed hourly.
According to a Reddit post on r/LocalLLaMA, llama.cpp released version 0.6.0, adding MTP speculative decoding for Qwen4Exp along with many other updates.
A pull request adding MTP support for Qwen4Exp was merged into llama.cpp after 17 hours of work, enabling MTP with Qwen Flash Next. Corresponding GGUF quantizations have been published on Hugging Face.