dash-infer
DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including CUDA, x86 and ARMv9.
modelscope/dash-infer
View on GitHub ↗DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including CUDA, x86 and ARMv9.
dash-infer grew -0.4% in the last 30 days, ranks 296th of 494 in Local Runtime / Inference Engine, last commit 444 days ago.
Star trajectory
115 days tracked-0.4% in 30d, below the Local Runtime / Inference Engine median of +1.7%.
Last commit 444 days ago, staler than the median of 5d.
How it compares in Local Runtime / Inference Engine
Ranked 296th of 494 by stars.
- Language
- C
- License
- Apache License 2.0
- Contributors
- 12
- Forks
- 29
- Watchers
- 8
- Open issues
- 7
- Releases
- 10
- Created
- 2024-04-01
- Stars this week
- +0
You've seen where dash-infer stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.