ClusterChat
A chatbot, with a large language model split across its users, entirely in the browser.
l-wn/ClusterChat
View on GitHub ↗A chatbot, with a large language model split across its users, entirely in the browser.
ClusterChat ranks 93rd of 99 in Distributed Inference, actively maintained, last commit 12 days ago.
Star trajectory
18 days tracked- in 30d, below the Distributed Inference median of +1.2%.
Last commit 12 days ago, staler than the median of 5d.
How it compares in Distributed Inference
Ranked 93rd of 99 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere ClusterChat sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan…
+24 (+9.9%) in 30d · Committed yesterday · Go · Apache-2.0
Shares Distributed Inference, Web / Edge / On-Device Runtime
An open harness to simulate and deploy PX4/ArduPilot/Betaflight perception-based drone swarms with ROS2, YOLO…
+30 (+4.7%) in 30d · Committed today · C++ · MIT
Shares Distributed Inference, Web / Edge / On-Device Runtime
Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding…
+56 (+9.3%) in 30d · Committed 19d ago · JavaScript · MIT
Shares Web / Edge / On-Device Runtime, Distributed Inference
Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac…
+1 (+0.7%) in 30d · Committed 36d ago · Python · Apache-2.0
Shares Distributed Inference, Web / Edge / On-Device Runtime
[Official] Prima.cpp: Scale Your Local AI Beyond One Device.
+20 (+18%) in 30d · Committed 76d ago · C++ · MIT
Shares Distributed Inference, Web / Edge / On-Device Runtime
Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully…
+8 (+7.1%) in 30d · Committed 114d ago · C
Shares Web / Edge / On-Device Runtime, Distributed Inference
Run GPU inference and training jobs on serverless infrastructure that scales with you.
+0 (+0.0%) in 30d · Committed 891d ago · Shell
Shares Distributed Inference, Web / Edge / On-Device Runtime
2bit quants, kernels and runtime for consumer devices.
Committed 16d ago · C++ · Other license
Shares Web / Edge / On-Device Runtime
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice…
+696 (+19%) in 30d · Committed today · C++ · Other license
Shares Web / Edge / On-Device Runtime
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
+83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2
Shares Web / Edge / On-Device Runtime
- Language
- JavaScript
- License
- GNU Affero General Public License v3.0
- Contributors
- 1
- Forks
- 4
- Watchers
- 0
- Open issues
- 1
- Releases
- 0
- Created
- 2026-10-09
- Stars this week
- +2
You've seen where ClusterChat stands today.
Get the moves before everyone else: the 5 Distributed Inference repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.