- CollectionLLM Gateway & Routing
- Classificationagent-native
- MCPUnavailable
- Agent SkillUnavailable
- InterfacesREST · SDK · http · API
What it does
Portkey is an AI gateway that sits between agent code and LLM providers. Agents send requests to Portkey’s OpenAI-compatible endpoint; Portkey handles routing, fallback, caching, budget enforcement, and observability — transparently, without the agent needing to know which underlying provider is serving the request.
The key primitives are specifically designed for agent workloads: virtual keys (per-agent scoped credentials), per-agent budget limits, sticky session routing (keep the same agent on the same provider during a multi-turn conversation), and agent-trace observability (trace multi-hop agent call chains with cost attribution per step).
Agent-facing interfaces
- Catalog protocols: REST, SDK, http, API
- MCP: ⚠️ No dedicated MCP server published.
- Agent Skill: ⚠️ No official skill published by Portkey yet.
- Onboarding type:
sdk
Protocol surface
| Interface | Detail |
|---|---|
| REST API | OpenAI-compatible endpoint: https://api.portkey.ai/v1 |
| Python SDK | pip install portkey-ai |
| Node SDK | npm install portkey-ai |
| Framework Support | OpenAI Agents SDK, LangChain, CrewAI, AutoGen, LlamaIndex, LangGraph — 2-line integration |
| LLM Coverage | 1,600+ models across 200+ providers |