distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

b4rtaz/distributed-llama

View on GitHub ↗

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

distributed-llama grew +1.7% in the last 30 days, ranks 58th of 490 in Local Runtime / Inference Engine, actively maintained, last commit 8 days ago.

Star trajectory

123 days tracked
2026-06-213.1k stars today2026-10-23
Momentum

+1.7% in 30d, below the Local Runtime / Inference Engine median of +1.7%.

Maintenance

Last commit 8 days ago, staler than the median of 5.5d.

How it compares in Local Runtime / Inference Engine

distributed-llama
3.1k
stars
+1.7% 30d
commit 8 days ago
Local Runtime / Inference Engine median
414.5
stars
+1.7% 30d
commit ~5.5d ago
Leader · ollama
184.4k
stars
+1.6% 30d
commit today

Ranked 58th of 490 by stars.

Language
C++
License
MIT License
Contributors
15
Forks
258
Watchers
52
Open issues
46
Releases
64
Created
2023-12-04
Stars this week
+2

You've seen where distributed-llama stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain distributed-llama?

Claim this page to add your own call-to-action.

Claim this page