ktransformers
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
kvcache-ai/ktransformers
View on GitHub ↗A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
ktransformers grew +0.5% in the last 30 days, ranks 16th of 496 in Local Runtime / Inference Engine, actively maintained, last commit 5 days ago.
Star trajectory
122 days tracked2026-06-2619.6k stars today2026-10-26
Momentum
+0.5% in 30d, below the Local Runtime / Inference Engine median of +1.7%.
Maintenance
Last commit 5 days ago, fresher than the median of 6d.
How it compares in Local Runtime / Inference Engine
ktransformers
19.6k
stars
+0.5% 30d
commit 5 days ago
Local Runtime / Inference Engine median
409.5
stars
+1.7% 30d
commit ~6d ago
Leader · ollama
184.8k
stars
+1.7% 30d
commit today
Ranked 16th of 496 by stars.
jundot/omlx23.1k-3.4klexmount/moli20.7k-1.1k
kvcache-ai/ktransformers19.6k
NVIDIA-NeMo/NeMo18.6k+1klabring/sealos18.4k+1.3k- Language
- Python
- License
- Apache License 2.0
- Contributors
- 133
- Forks
- 1.6k
- Watchers
- 120
- Open issues
- 471
- Releases
- 34
- Created
- 2024-07-26
- Stars this week
- +16
You've seen where ktransformers stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.