LiteLLM
OSS unified-API router for 100+ LLM providers with caching, fallbacks, and budgets.
- License
- MIT
- Install
- pip package
- Website
- https://www.litellm.ai
- GitHub
- https://github.com/BerriAI/litellm
pip install litellm
Portkey
Enterprise AI gateway with guardrails, caching, observability, and 200+ models.
- License
- MIT
- Install
- pip package
- Website
- https://portkey.ai
- GitHub
- https://github.com/Portkey-AI/gateway
pip install portkey-ai
When to reach for which
LiteLLM — OSS unified-API router for 100+ LLM providers with caching, fallbacks, and budgets.
Portkey — Enterprise AI gateway with guardrails, caching, observability, and 200+ models.
Both sit in the LLM Routers category — they're substitutes, not complements. Pick by your install constraint (MCP-native, license, hosting model) and which tag overlap matters most to your stack.