litellm

A lightweight AI gateway to call 100+ LLM APIs with cost tracking and guardrails.

• Respan launches open-source Rust AI gateway built around plugins2026-10-20