| Website | portkey.ai |
| Category | AI / LLM Infrastructure |
| License | Open source (Enterprise features) |
| Pricing | Free tier, Growth from $49/mo |
Overview
Portkey is an AI gateway with built-in observability. Route requests to 250+ LLMs, add caching, fallbacks, and load balancing. Monitor costs and latency.
Pros
- 250+ LLM provider routing
- Built-in caching
- Automatic fallbacks
- Cost and latency monitoring
- Guardrails and policies
- API key management
Cons
- Growth pricing adds up
- Adds proxy latency
- Enterprise features behind paywall
- Dependency on gateway
- Some features cloud-only
Verdict
Portkey is the control plane for multi-model AI applications. Route requests to the best model for each task, cache repeated queries, fall back to alternative providers when one is down, and track costs across every LLM call. For companies spending significant money on LLM APIs, Portkey provides the visibility and optimization layer that pays for itself in saved costs.