inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
xorbitsai/inference
View on GitHub ↗Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
inference grew +0.4% in the last 30 days, ranks 19th of 320 in Production Serving & Deployment, actively maintained, last commit today.
Star trajectory
121 days tracked+0.4% in 30d, below the Production Serving & Deployment median of +1.2%.
Last commit today, fresher than the median of 3d.
How it compares in Production Serving & Deployment
Ranked 19th of 320 by stars.
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 183
- Forks
- 890
- Watchers
- 58
- Open issues
- 7
- Releases
- 149
- Created
- 2023-06-14
- Stars this week
- +13
You've seen where inference stands today.
Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.