Portkey

Free tier

Production stack for Gen AI builders — AI Gateway, Observability, Guardrails & more

Free tier available·Technical·API available·Open source

Key strengths

Unified API access to 1,600+ LLMs via a single AI GatewayReal-time LLM observability, logging, and anomaly detectionBuilt-in guardrails and AI governance controlsPrompt management without hard-coded promptsOpen-source core with plug-and-play 3-line integration

Free tier + paid plans

San Francisco, USA

Founded 2023

Self-hostable

Get alerts when Portkey changes

Free. We'll email you when pricing, the free tier, API access or open-source status changes.

No ratings yet

Portkey is an open-source AI infrastructure layer that exposes a unified, OpenAI-compatible API to route requests across 1,600+ LLMs. It implements the AI Gateway pattern — acting as a centralized proxy that handles load balancing, caching, retries, and fallbacks — while layering on real-time observability, configurable guardrails, prompt versioning, and an MCP (Model Context Protocol) Gateway for secure tool access. The SDK is available for Node.js and Python and integrates in as few as 3 lines of code with no changes to existing stacks. It supports self-hosting and integrates with Azure, MongoDB, GitHub, Docker, Auth0, Cloudflare, and Figma ecosystems.

Alternatives

Alternatives to Portkey

See all alternatives

Hugging Face

Free

AI infrastructure

The GitHub of AI — host, share, and run models with 500K+ models, datasets, and Spaces.

Team & Enterprise starting at $20/user/month; GPU compute starting at $0.60/hour for Inference Endpoints

GitHubDiscordPyTorchTensorFlow

Free tierDevAPIOSSSelf-host

Community (various)162k10M+ users

RunPod

Free

AI infrastructure

The AI Developer Cloud — experiment, train, fine-tune, deploy, and scale on one platform

Pay-as-you-go GPU compute; Serverless has zero idle cost. See runpod.io/pricing.

DockerHugging FacePyTorchTensorFlow+1

Free tierDevAPI

Popular

Together AI

Free

AI infrastructure

The AI Native Cloud — full-stack platform for inference, compute, and model shaping

Usage-based pricing for serverless inference (per token), batch inference, provisioned throughput (token-based capacity with SLAs), dedicated model inference, and dedicated container inference. GPU compute clusters also available.

GPU ClustersModel LibraryInference APIsFine-tuning+1

Free tierDevAPI

Open-source models (e.g., DeepSeek, Gemma, Llama, Qwen, GLM, MiniMax, Kimi)Popular

Modal

Free

AI infrastructure

High-performance AI infrastructure with sub-second cold starts and instant autoscaling

$30/month free compute · pay-per-second GPU usage

PythonS3WebRTCWebSocket

Free tierDevAPI

Popular

LiveKit

Free

AI infrastructure

The open source framework and cloud platform for voice, video, and physical AI agents

Free tier ($0/mo, 1,000 free agent session minutes/month); Ship plan starting at $50/mo; Scale plan starting at $500/mo; Enterprise with custom pricing. Usage-based pricing per minute for agent sessions, telephony, LLM, STT, TTS, and observability.

GitHubSlack

Free tierDevAPIOSSSelf-host

15kGrowing

Groq

Free

AI infrastructure

Fast, low-cost AI inference powered by custom LPU silicon

Free API key available; see pricing page for details

OpenAIDiscordDocs API

Free tierEveryoneAPI

Groq (third-party models hosted on LPU infrastructure)Popular

Compare head-to-head:Portkey vs Hugging Face Portkey vs RunPod Portkey vs Together AI

Browse all 29 ai infrastructure tools

Is Portkey yours? Claim the listing & get the badge