Anyscale

Free tier

Production-scale AI infrastructure powered by Ray — built for foundation model workloads

Free tier available·Technical·API available

Key strengths

Built on Ray, the world's most widely adopted AI compute engine (500M+ downloads, 41K+ GitHub stars)Elastic distributed training across thousands of GPU nodes with PyTorch, vLLM, and SGLang supportMulti-cloud orchestration across AWS, GCP, Azure, Nebius, and CoreWeave without code rewritesFine-grained hardware allocation enabling per-task CPU/GPU/TPU assignmentAdvanced observability, access controls (SSO, SAML, SCIM), and audit logs for enterprise governance

Free tier + paid plans

San Francisco, USA

Founded 2019

Self-hostable

Facts verified against anyscale.com on Oct 5, 2026

Recent changes

Oct 5, 2026Open source: now available
Oct 5, 2026Self-hosting: now available
Oct 5, 2026Plans updated: Pay-as-you-go with $100 free credit to start. Hosted and BYOC options. Compute billed per hour (e.g. CPU-only AC $0.0135/hr, NVIDIA T4 AC $0.5682/hr, NVIDIA L4 AC $0.9542/hr, NVIDIA A10G AC $1.3635/hr, NVIDIA A100 AC $4.9591/hr). Committed contracts available for volume discounts.

What's changed across AI tools →

Get alerts when Anyscale changes

Free. We'll email you when pricing, the free tier, API access or open-source status changes.

No ratings yet

Developer Docs & Integration

Anyscale is built on Ray, which is open source and self-hostable. The managed Anyscale platform layers production scheduling, observability, and enterprise controls on top of the Ray API surface developers already know.

Integration surface:

Training frameworks: PyTorch, XGBoost, SkyRL, veRL
Inference engines: vLLM, SGLang
Infrastructure: AWS, GCP, Azure, Nebius, CoreWeave, Kubernetes (for BYOC/on-prem)
Auth & compliance: SSO, SAML, SCIM, audit logs

Deployment models:

Hosted — fully managed by Anyscale
BYOC (Bring Your Own Cloud) — Anyscale control plane, your cloud account and VPC
Self-hosted / on-prem — deploy Ray directly on Kubernetes

Compute pricing reference (AC = Anyscale Compute):

Hardware	Price/hr
CPU-only	$0.0135
NVIDIA T4	$0.5682
NVIDIA L4	$0.9542
NVIDIA A10G	$1.3635
NVIDIA A100	$4.9591

Committed contracts are available for volume discounts.

Alternatives

Alternatives to Anyscale

See all alternatives

Hugging Face

Free

AI infrastructure

The GitHub of AI — host, share, and run models with 500K+ models, datasets, and Spaces.

Team & Enterprise starting at $20/user/month; GPU compute starting at $0.60/hour for Inference Endpoints

GitHubDiscordPyTorchTensorFlow

Free tierDevAPIOSSSelf-host

Community (various)162k10M+ users

Fireworks AI

Free

AI infrastructure

The fastest inference platform for generative AI — train, tune, and deploy open models at production scale.

Serverless inference billed per token (input/output/cached); embeddings from $0.008/1M tokens; training from $0.50/1M tokens (LoRA SFT, models up to 16B); on-demand GPU from $8.00/hr (H100) to $20.00/hr (GB300).

AzureVercel

Free tierEveryoneAPISelf-host

Multiple open-source models (DeepSeek, Llama, Mistral, Qwen, GLM, Kimi, Gemma, etc.) plus closed-model API compatibility (OpenAI, Anthropic)Popular

fal.ai

Free

AI infrastructure

Generative media platform for developers — run 1,000+ image, video, audio & 3D models at lightning speed.

Serverless: pay-per-output · Compute: from $1.89/hr for H100s

PythonJavaScriptAPI

Free tierDevAPI

Multiple (FLUX, Kling, Seedance, Veo, Ideogram, and 1,000+ others)10M+ users

Together AI

Free

AI infrastructure

The AI Native Cloud — full-stack platform for inference, compute, and model shaping

Usage-based pricing for serverless inference (per token), batch inference, provisioned throughput (token-based capacity with SLAs), dedicated model inference, and dedicated container inference. GPU compute clusters also available.

GPU ClustersModel LibraryInference APIsFine-tuning+1

Free tierDevAPI

Open-source models (e.g., DeepSeek, Gemma, Llama, Qwen, GLM, MiniMax, Kimi)Popular

Baseten

AI infrastructure

The fastest AI model inference platform for production-grade deployments

Contact sales for pricing

CursorNotionDescript

PaidDevAPISelf-host

Popular

Replicate

Free

AI infrastructure

Run open-source AI models in the cloud via a simple API — images, video, audio, and LLMs.

Pay-per-use: public models billed by time (e.g. CPU $0.000100/sec, Nvidia T4 $0.000225/sec, Nvidia L40S $0.000975/sec, Nvidia A100 80GB $0.001400/sec) or by input/output (e.g. flux-1.1-pro $0.04/image, deepseek-r1 $0.01/1K output tokens). Private models billed for all online time including idle.

Node.jsPythonHTTP

Free tierDevAPIOSS

Multi-provider (Black Forest Labs, OpenAI, Google, Anthropic, ByteDance, xAI, Alibaba, Recraft, Minimax, and community models)Popular

Compare head-to-head:Anyscale vs Hugging Face Anyscale vs Fireworks AI Anyscale vs fal.ai

Browse all 29 ai infrastructure tools

Is Anyscale yours? Claim the listing & get the badge