LiteLLM

Open-source gateway for calling 100+ LLM APIs

LiteLLM provides an OpenAI-compatible gateway and Python SDK for calling more than 100 language model APIs through one interface. The proxy adds routing, retries, virtual keys, budgets, guardrails, usage tracking, and MCP access controls for production agent systems.