litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
BerriAI/litellm
View on GitHub ↗The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
litellm grew +4.0% in the last 30 days, ranks 3rd of 320 in Production Serving & Deployment, actively maintained, last commit today.
Star trajectory
121 days tracked+4.0% in 30d, above the Production Serving & Deployment median of +1.2%.
Last commit today, fresher than the median of 3d.
How it compares in Production Serving & Deployment
Ranked 3rd of 320 by stars.
- Language
- Python
- License
- Other
- Contributors
- 1,864
- Forks
- 12.6k
- Watchers
- 233
- Open issues
- 1.8k
- Releases
- 1,000
- Created
- 2023-07-27
- Stars this week
- +532
You've seen where litellm stands today.
Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.