---
slug: "litellm"
name: "LiteLLM"
effect: "Calls 100+ LLM providers in the OpenAI format, as a Python SDK or a self-hosted AI gateway"
category: "model-api"
url: "https://docs.litellm.ai"
github: "BerriAI/litellm"
pricing: "open-source"
license: "MIT; enterprise/ directory under the BerriAI Enterprise license"
tags: ["gateway", "proxy", "unified-api", "openai-compatible", "python", "self-hosted"]
platforms: ["docker"]
install_kind: "pip"
date_added: "2026-10-14"
drop_score: 77
stars: 61264
pushed_at: "2026-10-15T01:18:30Z"
signals_status: "ok"
signals_fetched_at: "2026-10-15T01:19:00.790Z"
page: "https://agenttooldrop.com/tools/litellm"
---

# LiteLLM

Calls 100+ LLM providers in the OpenAI format, as a Python SDK or a self-hosted AI gateway

Category: Models and APIs. Pricing: Open source. License: MIT; enterprise/ directory under the BerriAI Enterprise license.

Platforms: docker.

## Why you would want it

LiteLLM gives one interface to OpenAI, Anthropic, Gemini, Bedrock, Azure and many other providers using the OpenAI request format, so you can swap providers without rewriting code. The Python SDK includes a Router with retry and fallback logic across deployments. The proxy server adds virtual keys, per-project spend tracking, guardrails, load balancing and an admin dashboard, and it can also act as an MCP gateway and an A2A agent gateway.

## Best for

- Platform teams centralizing LLM access
- Multi-provider apps with fallbacks
- Tracking spend per project or key

## Use it when

You call several model providers and want one OpenAI-format API, or a central gateway with keys, budgets and logging for a team.

## Skip it if

You use a single provider and its own SDK covers your needs. Features such as SSO sit under the commercial enterprise license.

## Install

Install with uv:

```sh
uv add litellm
```

Source: https://github.com/BerriAI/litellm#readme

## Live signals

Fetched 2026-10-15T01:19:00.790Z (status: ok).

- Repository: BerriAI/litellm
- Stars: 61,264
- Forks: 12,343
- Open issues and PRs: 5,599
- License (GitHub): NOASSERTION
- Last push: 2026-10-15
- Latest release: v1.105.1 (2026-10-14)

## Links

- Website: https://docs.litellm.ai
- GitHub: https://github.com/BerriAI/litellm
- Install instructions verified at: https://github.com/BerriAI/litellm#readme
- Source for this entry: https://github.com/BerriAI/litellm#readme
- AgentToolDrop page: https://agenttooldrop.com/tools/litellm
- Full catalog (JSON): https://agenttooldrop.com/tools.json