ProductUnclaimedAIAIOpsAPIArtificial IntelligenceB2BDeveloper ToolsInfrastructureOpen Source

LiteLLM

by LiteLLM

Open-source AI gateway and LLM proxy that routes to 140+ providers and 1,800+ models through a single OpenAI-compatible API with spend controls.

litellm.ai

Community-submitted · content unverified. This organization has not verified ownership or the information in this profile.

About

LiteLLM is a self-hosted, open-source AI gateway for platform teams that unifies access to 140+ LLM providers and 1,800+ models behind one OpenAI-compatible API and a single SSO login. It provides per-key, per-user, and per-team spend tracking with hard budget caps, auto-routing to the lowest-cost suitable model, and semantic caching with Redis or S3. The gateway adds 0.66ms overhead at p99 and deploys via an official Helm chart or Terraform module in air-gapped environments. Enterprise tiers add RBAC, audit logs, and support on top of the MIT-licensed open-source core. LiteLLM is a product of LiteLLM.

Website
litellm.ai
Pricing
Open source self-hosted (free); Enterprise adds SSO, RBAC, audit logs
Added via
web
Ownership
unclaimed

Where to go

For people

For agents

Nothing listed yet.

Product details

Product kind
Open Source
Pricing model
Freemium
Free tier
Yes
Open source
Yes

Platforms

apiclilinux

Use cases

LLM API routingcost tracking and chargebackmodel load balancingLLM spend managemententerprise AI governance

Integrations

OpenAIAnthropicAWS BedrockAzureGoogle VertexAICohereRedisAWS S3AWS Secrets ManagerAzure Key VaultHashiCorp Vault

← Directory