BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Quick read
- Stars
- 61,355
- Forks
- 12,395
- Open issues
- 5,485
- Commits
- 54,633
Activity and growth
Latest capture 2026-10-16 04:38
- Stars · last 7 days
- +79 +0.1%
- Commits · last 7 days
- +159 +0.3%
- Stars since tracking
- +13350
- Stored snapshots
- 76
Classification
Metadata
- Language
- Python
- License
- NOASSERTION
- Default branch
- main
- Created
- 2023-07-27
- First commit
- 2023-07-27
- Last pushed
- 2026-10-16
- GitHub updated
- 2026-10-16
- Last synced
- 2026-10-16 04:38
- Stack scanned
- 2026-10-16 04:38
- Archived
- No
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
AI development signals
99 paths
Agent instructions and tool configuration found in this repository.
Agent instructions 98
Gemini CLI
View paths
- AGENTS.md
- GEMINI.md
- litellm-rust/AGENTS.md
- litellm-rust/crates/cache-response/AGENTS.md
- litellm-rust/crates/callbacks-legacy-python/AGENTS.md
- litellm-rust/crates/coroutine/AGENTS.md
- litellm-rust/crates/gateway-auth/AGENTS.md
- litellm-rust/crates/gateway-inference/AGENTS.md
- litellm-rust/crates/gateway-mcp/AGENTS.md
- litellm-rust/crates/gateway/AGENTS.md
- litellm-rust/crates/host-http/AGENTS.md
- litellm-rust/crates/host-native/AGENTS.md
- litellm-rust/crates/host-python/AGENTS.md
- litellm-rust/crates/host/AGENTS.md
- litellm-rust/crates/host/src/machine/AGENTS.md
- litellm-rust/crates/http/AGENTS.md
- litellm-rust/crates/inference-chat/AGENTS.md
- litellm-rust/crates/inference-messages/AGENTS.md
- litellm-rust/crates/inference-ocr/AGENTS.md
- litellm-rust/crates/inference-responses/AGENTS.md
- litellm-rust/crates/inference-transcription/AGENTS.md
- litellm-rust/crates/inference/AGENTS.md
- litellm-rust/crates/llms-types/AGENTS.md
- litellm-rust/crates/llms-types/src/formats/audio_transcription/AGENTS.md
75 more paths detected.
Growth history
Tracked growth
76 observed captures since 2026-05-23. Observed captures are shown by default.
Stars from first capture +13350
Chart data
Observed captures only
Time horizon
All tracked data
Custom date range
Stars history
Observed snapshots
Commits history
Observed snapshots