Portkey
Free tierProduction stack for Gen AI builders — AI Gateway, Observability, Guardrails & more
Key strengths
Portkey is an open-source AI infrastructure layer that exposes a unified, OpenAI-compatible API to route requests across 1,600+ LLMs. It implements the AI Gateway pattern — acting as a centralized proxy that handles load balancing, caching, retries, and fallbacks — while layering on real-time observability, configurable guardrails, prompt versioning, and an MCP (Model Context Protocol) Gateway for secure tool access. The SDK is available for Node.js and Python and integrates in as few as 3 lines of code with no changes to existing stacks. It supports self-hosting and integrates with Azure, MongoDB, GitHub, Docker, Auth0, Cloudflare, and Figma ecosystems.
