openinfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
openinfer-project/openinfer
View on GitHub ↗Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
openinfer grew +1.8% in the last 30 days, ranks 185th of 494 in Local Runtime / Inference Engine, actively maintained, last commit today.
Star trajectory
115 days tracked2026-07-02725 stars today2026-10-25
Momentum
+1.8% in 30d, above the Local Runtime / Inference Engine median of +1.7%.
Maintenance
Last commit today, fresher than the median of 5d.
How it compares in Local Runtime / Inference Engine
openinfer
725
stars
+1.8% 30d
commit today
Local Runtime / Inference Engine median
414
stars
+1.7% 30d
commit ~5d ago
Leader · ollama
184.7k
stars
+1.7% 30d
commit today
Ranked 185th of 494 by stars.
- Language
- Rust
- License
- Apache License 2.0
- Contributors
- 39
- Forks
- 121
- Watchers
- 4
- Open issues
- 42
- Releases
- 2
- Created
- 2026-02-17
- Stars this week
- +1
Local Runtime / Inference EngineProduction Serving & DeploymentInference OptimizationModel Optimization
You've seen where openinfer stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.