willow-inference-server
Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
toverainc/willow-inference-server
View on GitHub ↗Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
willow-inference-server grew +0.0% in the last 30 days, ranks 122nd of 324 in Production Serving & Deployment, last commit 255 days ago.
Star trajectory
127 days tracked2026-06-20511 stars today2026-10-26
Momentum
+0.0% in 30d, below the Production Serving & Deployment median of +1.2%.
Maintenance
Last commit 255 days ago, staler than the median of 3d.
How it compares in Production Serving & Deployment
willow-inference-server
511
stars
+0.0% 30d
commit 255 days ago
Production Serving & Deployment median
314
stars
+1.2% 30d
commit ~3d ago
Leader · vllm
95.6k
stars
+3.1% 30d
commit today
Ranked 122nd of 324 by stars.
ome-projects/ome520-9huawei-csl/KVarN513-2
toverainc/willow-inference-server511
Chen-zexi/vllm-cli505+6vectorch-ai/ScaleLLM498+13- Language
- Python
- License
- Apache License 2.0
- Contributors
- 9
- Forks
- 60
- Watchers
- 16
- Open issues
- 38
- Releases
- 0
- Created
- 2023-02-03
- Stars this week
- +0
You've seen where willow-inference-server stands today.
Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.