Redis

Redis creator releases ds4 local LLM inference engine

The creator of Redis released ds4, a narrow C inference engine that runs frontier open-weight models such as DeepSeek V4, GLM 5.x and Qwen3.8 locally on high-memory Macs and CUDA/ROCm machines. MIT-licensed, it bundles a CLI, HTTP APIs and a native agent, using asymmetric quantization to make MoE models practical locally, with roughly 34.4 T/s generation and 557 T/s prefill on a 128GB Mac.