MACaQ

1 stories

Every MACaQ story collected by The AI Daily, 1 so far, newest first, refreshed hourly.

Related topics

Huawei open-sources MACaQ quantizer for local inference

Huawei released MACaQ, an internal quantizer supporting llama.cpp, vLLM, Diffusers and PyTorch across text, image, video and audio models. Huawei says it can quantize a 122B-parameter model in 64 minutes with 32.5 GB of device memory, matching or beating MR-GPTQ and DuQuant++ perplexity with far less quantization time.

Hacker News ·
That is everything