BentoML
Free tierRun AI inference at scale — deploy any model anywhere with full control and no complexity.
Key strengths
Facts verified against bentoml.com on
Get alerts when BentoML changes
Free. We'll email you when pricing, the free tier, API access or open-source status changes.
BentoML is an open-source framework for building, deploying, and scaling AI model inference in production. Founded in 2019 and backed by 8,877+ GitHub stars, it is designed for AI/ML engineering teams who need flexible, self-hostable model serving across any cloud or on-premises infrastructure. BentoML exposes an API layer that supports any model architecture, framework, or modality, and integrates natively with leading inference runtimes and model ecosystems including vLLM, TRT-LLM, SGLang, JAX, PyTorch, Transformers, HuggingFace, and models such as Llama 4, DeepSeek, GPT-OSS, Flux, and Qwen. It supports distributed LLM inference across multiple GPUs (Nvidia and AMD), intelligent auto-scaling with cold-start acceleration and scale-to-zero, and Kubernetes-native deployment. Built-in observability and CI/CD automation round out a production-ready serving platform with enterprise-grade security and data sovereignty controls.
Alternatives to BentoML
Is BentoML yours? Claim the listing & get the badge