litellm-rs

Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.

majiayu000/litellm-rs

View on GitHub ↗

Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.

litellm-rs grew +4.3% in the last 30 days, ranks 205th of 268 in LLM Gateway & Routing, actively maintained, last commit 9 days ago.

Star trajectory

103 days tracked
2026-07-14121 stars today2026-10-25
Momentum

+4.3% in 30d, above the LLM Gateway & Routing median of +2.1%.

Maintenance

Last commit 9 days ago, staler than the median of 5d.

How it compares in LLM Gateway & Routing

litellm-rs
121
stars
+4.3% 30d
commit 9 days ago
LLM Gateway & Routing median
206.5
stars
+2.1% 30d
commit ~5d ago
Leader · OmniRoute
80.8k
stars
+15.5% 30d
commit today

Ranked 205th of 268 by stars.

Language
Rust
License
MIT License
Contributors
7
Forks
18
Watchers
2
Open issues
1
Releases
5
Created
2025-07-15
Stars this week
+0

You've seen where litellm-rs stands today.

Get the moves before everyone else: the 5 LLM Gateway & Routing repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain litellm-rs?

Claim this page to add your own call-to-action.

Claim this page