AI infrastructure AI tools

GitHubDiscordPyTorchTensorFlow

AI infrastructure

The GitHub of AI — host, share, and run models with 500K+ models, datasets, and Spaces.

Team & Enterprise starting at $20/user/month; GPU compute starting at $0.60/hour for Inference Endpoints

Community (various)162k10M+ users

Together AI

GPU ClustersModel LibraryInference APIsFine-tuning+1

AI infrastructure

The AI Native Cloud — full-stack platform for inference, compute, and model shaping

Usage-based pricing for serverless inference (per token), batch inference, provisioned throughput (token-based capacity with SLAs), dedicated model inference, and dedicated container inference. GPU compute clusters also available.

Open-source models (e.g., DeepSeek, Gemma, Llama, Qwen, GLM, MiniMax, Kimi)Popular

Groq

Groq (third-party models hosted on LPU infrastructure)Popular

AI infrastructure

Fast, low-cost AI inference powered by custom LPU silicon

Free API key available; see pricing page for details

OpenAIDiscordDocs API

Free tierEveryoneAPI

Replicate

Multi-provider (Black Forest Labs, OpenAI, Google, Anthropic, ByteDance, xAI, Alibaba, Recraft, Minimax, and community models)Popular

AI infrastructure

Run open-source AI models in the cloud via a simple API — images, video, audio, and LLMs.

Pay-per-use: public models billed by time (e.g. CPU $0.000100/sec, Nvidia T4 $0.000225/sec, Nvidia L40S $0.000975/sec, Nvidia A100 80GB $0.001400/sec) or by input/output (e.g. flux-1.1-pro $0.04/image, deepseek-r1 $0.01/1K output tokens). Private models billed for all online time including idle.

Node.jsPythonHTTP

Free tierDevAPIOSS

Weights & Biases

LangChainLlamaIndexPyTorchHugging Face+1

AI infrastructure

ML experiment tracking, model evaluation, and LLMOps platform used by leading AI teams

Free tierDevAPISelf-host

Vercel AI SDK

Multi-provider (100+ models via Vercel AI Gateway)27k10M+ users

AI infrastructure

TypeScript toolkit for building streaming AI chat apps with React and multiple LLM providers

Free · AI Gateway available

ReactNext.jsVueSvelte+1

FreeDevAPIOSSSelf-host

Anyscale

PyTorchvLLMSGLangXGBoost+8

AI infrastructure

Production-scale AI infrastructure powered by Ray — built for foundation model workloads

Pay-as-you-go with $100 free credit to start. Hosted and BYOC options. Compute billed per hour (e.g. CPU-only AC $0.0135/hr, NVIDIA T4 AC $0.5682/hr, NVIDIA L4 AC $0.9542/hr, NVIDIA A10G AC $1.3635/hr, NVIDIA A100 AC $4.9591/hr). Committed contracts available for volume discounts.

Free tierDevAPISelf-host

AWS Bedrock

AI infrastructure

Fully managed LLM APIs on AWS — access Claude, Llama, Mistral, and others in your AWS infrastructure.

OpenAIAWS

Anthropic / Meta / Mistral / Amazon10M+ users

Banana

AI infrastructure

GPU inference hosting for AI teams who ship fast and scale faster

$1200/mo Team + at-cost compute, Enterprise custom pricing

GitHubCLI

Growing

Baseten

AI infrastructure

The fastest AI model inference platform for production-grade deployments

Contact sales for pricing

CursorNotionDescript

PaidDevAPISelf-host

BentoML

AI infrastructure

Run AI inference at scale — deploy any model anywhere with full control and no complexity.

Open-source free tier · Bento Cloud & enterprise plans (contact for pricing)

vLLMPipecatLiveKitWandB+1

8.9kGrowing

Cerebrium

AI infrastructure

Serverless GPU infrastructure for real-time AI with sub-second cold starts and instant autoscaling

Usage-based serverless GPU pricing; no reservations or lock-ins required

Growing

DeepInfra

Multi-provider (DeepSeek, Anthropic/Claude, Qwen, Llama, Mistral, Gemini, Kimi, Flux, Nemotron, and others)

AI infrastructure

FAST SIMPLE RELIABLE LOW-COST AI Inference

Pay-as-you-go per-token pricing for language models (e.g. from $0.06/1M input tokens) and per-execution-time for other models; no long-term contracts or upfront costs.

Free tierEveryoneAPI

fal.ai

AI infrastructure

Generative media platform for developers — run 1,000+ image, video, audio & 3D models at lightning speed.

Serverless: pay-per-output · Compute: from $1.89/hr for H100s

PythonJavaScriptAPI

Multiple (FLUX, Kling, Seedance, Veo, Ideogram, and 1,000+ others)10M+ users

Fireworks AI

Free tierEveryoneAPISelf-host

AI infrastructure

The fastest inference platform for generative AI — train, tune, and deploy open models at production scale.

Serverless inference billed per token (input/output/cached); embeddings from $0.008/1M tokens; training from $0.50/1M tokens (LoRA SFT, models up to 16B); on-demand GPU from $8.00/hr (H100) to $20.00/hr (GB300).

AzureVercel

Multiple open-source models (DeepSeek, Llama, Mistral, Qwen, GLM, Kimi, Gemma, etc.) plus closed-model API compatibility (OpenAI, Anthropic)Popular

Helicone

OpenAIAnthropicAzureLiteLLM+3

AI infrastructure

AI Gateway & LLM Observability for building reliable AI applications

LLMRAGEnterprise Data Systems

Iris.ai

AI infrastructure

AI knowledge foundation for regulated enterprises — turning complex data into AI you can trust

EnterpriseDevAPI

Growing

LiveKit

AI infrastructure

The open source framework and cloud platform for voice, video, and physical AI agents

Free tier ($0/mo, 1,000 free agent session minutes/month); Ship plan starting at $50/mo; Scale plan starting at $500/mo; Enterprise with custom pricing. Usage-based pricing per minute for agent sessions, telephony, LLM, STT, TTS, and observability.

GitHubSlack

15kGrowing

LM Studio

JavaScript SDKPython SDKCLIOpenAI API

AI infrastructure

Run AI models locally and privately on your own hardware

Free for home and work use

Free tierEveryoneAPISelf-host

Multiple (Qwen, Gemma, DeepSeek, GPT-OSS, Apple MLX, etc.)Growing

Modal

AI infrastructure

High-performance AI infrastructure with sub-second cold starts and instant autoscaling

$30/month free compute · pay-per-second GPU usage

PythonS3WebRTCWebSocket

NVIDIA Run:aiHuggingFaceCUDA-XNVIDIA AI Enterprise+1

NVIDIA DGX Cloud Lepton

AI infrastructure

Connect developers to a global network of GPU compute for building and deploying AI

Enterprise pricing; contact NVIDIA for details

NVIDIA10M+ users

Ollama

Free tierEveryoneAPIOSSSelf-host

AI infrastructure

The easiest way to build and run open-source AI models locally

Free tier · Pro $20/mo or $200/yr · Max $100/mo

OpenClawClaude

Open-source models (Llama, Mistral, Gemma, etc.)Popular

OpenAI API

AI infrastructure

The most widely used AI API — access GPT-4o, DALL·E, Whisper, and Embeddings from OpenAI.

JavaScriptCookies

NVIDIAScaniaHyundaiIVECO+1

OpenAI

Plus AI

AI infrastructure

Transforming transportation with Physical AI-powered autonomous trucking

Enterprise only — contact for pricing

EnterpriseDev

PlusAI (proprietary DNNs + NVIDIA Alpamayo Foundation Model)Niche

Portkey

GitHubAzureMongoDBDocker+3

AI infrastructure

Production stack for Gen AI builders — AI Gateway, Observability, Guardrails & more

Free tier available with paid plans

RunPod

DockerHugging FacePyTorchTensorFlow+1

AI infrastructure

The AI Developer Cloud — experiment, train, fine-tune, deploy, and scale on one platform

Pay-as-you-go GPU compute; Serverless has zero idle cost. See runpod.io/pricing.

SambaNova

OpenAI-compatible APISambaOrchestratorSambaStackSambaCloud+1

AI infrastructure

The Fastest AI Inference Platform

Free tierEveryoneAPISelf-host

SambaNova (own RDU hardware; OpenAI-compatible APIs; frontier open-weight models)

Typesense