The A.I. Daily
YC S25 Startup Magnitude Launches Self-Optimizing Inference Engine for Agents
Magnitude launched a self-optimizing inference engine for agents that runs on Mac, Linux, and Windows on any hardware and is up to 2x faster than llama.cpp. It features on-device compilation and tuning, dynamic memory allocation, and hybrid paged attention, designed for running local agents.