ClusterChat

A chatbot, with a large language model split across its users, entirely in the browser.

l-wn/ClusterChat

View on GitHub ↗

A chatbot, with a large language model split across its users, entirely in the browser.

ClusterChat ranks 93rd of 99 in Distributed Inference, actively maintained, last commit 12 days ago.

Star trajectory

18 days tracked
2026-11-0457 stars today2026-11-22
Momentum

- in 30d, below the Distributed Inference median of +1.2%.

Maintenance

Last commit 12 days ago, staler than the median of 5d.

How it compares in Distributed Inference

ClusterChat
57
stars
- 30d
commit 12 days ago
Distributed Inference median
299
stars
+1.2% 30d
commit ~5d ago
Leader · exo
48.5k
stars
+1.1% 30d
commit 15 days ago

Ranked 93rd of 99 by stars.

Ranked by shared tags, then keywords, then stars
  1. Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan…

    +24 (+9.9%) in 30d · Committed yesterday · Go · Apache-2.0

    Shares Distributed Inference, Web / Edge / On-Device Runtime

  2. An open harness to simulate and deploy PX4/ArduPilot/Betaflight perception-based drone swarms with ROS2, YOLO…

    +30 (+4.7%) in 30d · Committed today · C++ · MIT

    Shares Distributed Inference, Web / Edge / On-Device Runtime

  3. Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding…

    +56 (+9.3%) in 30d · Committed 19d ago · JavaScript · MIT

    Shares Web / Edge / On-Device Runtime, Distributed Inference

  4. Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac…

    +1 (+0.7%) in 30d · Committed 36d ago · Python · Apache-2.0

    Shares Distributed Inference, Web / Edge / On-Device Runtime

  5. [Official] Prima.cpp: Scale Your Local AI Beyond One Device.

    +20 (+18%) in 30d · Committed 76d ago · C++ · MIT

    Shares Distributed Inference, Web / Edge / On-Device Runtime

  6. Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully…

    +8 (+7.1%) in 30d · Committed 114d ago · C

    Shares Web / Edge / On-Device Runtime, Distributed Inference

  7. Run GPU inference and training jobs on serverless infrastructure that scales with you.

    +0 (+0.0%) in 30d · Committed 891d ago · Shell

    Shares Distributed Inference, Web / Edge / On-Device Runtime

  8. 2bit quants, kernels and runtime for consumer devices.

    Committed 16d ago · C++ · Other license

    Shares Web / Edge / On-Device Runtime

  9. An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice…

    +696 (+19%) in 30d · Committed today · C++ · Other license

    Shares Web / Edge / On-Device Runtime

  10. NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

    +83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2

    Shares Web / Edge / On-Device Runtime

Language
JavaScript
License
GNU Affero General Public License v3.0
Contributors
1
Forks
4
Watchers
0
Open issues
1
Releases
0
Created
2026-10-09
Stars this week
+2

You've seen where ClusterChat stands today.

Get the moves before everyone else: the 5 Distributed Inference repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain ClusterChat?

Claim this page to add your own call-to-action.

Claim this page