esp32s3-distributed-ai
Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully offline.
wladimiravila/esp32s3-distributed-ai
View on GitHub ↗Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully offline.
esp32s3-distributed-ai grew +7.1% in the last 30 days, ranks 151st of 177 in Web / Edge / On-Device Runtime, last commit 114 days ago.
Star trajectory
82 days tracked+7.1% in 30d, above the Web / Edge / On-Device Runtime median of +1.8%.
Last commit 114 days ago, staler than the median of 6d.
How it compares in Web / Edge / On-Device Runtime
Ranked 151st of 177 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere esp32s3-distributed-ai sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding…
+56 (+9.3%) in 30d · Committed 19d ago · JavaScript · MIT
Shares Web / Edge / On-Device Runtime, Distributed Inference, Inference Optimization
Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac…
+1 (+0.7%) in 30d · Committed 36d ago · Python · Apache-2.0
Shares Distributed Inference, Inference Optimization, Web / Edge / On-Device Runtime
[Official] Prima.cpp: Scale Your Local AI Beyond One Device.
+20 (+18%) in 30d · Committed 76d ago · C++ · MIT
Shares Distributed Inference, Web / Edge / On-Device Runtime, Inference Optimization
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs…
+3 (+0.6%) in 30d · Committed 320d ago · Python · Apache-2.0
Shares Inference Optimization, Distributed Inference
Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream…
+6 (+1.5%) in 30d · Committed 87d ago · Shell · MIT
Shares Inference Optimization, Distributed Inference
SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7…
+9 (+3.9%) in 30d · Committed 81d ago · Rust · Other license
Shares Inference Optimization, Distributed Inference
DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context)…
+27 (+19%) in 30d · Committed 26d ago · Python · MIT
Shares Distributed Inference, Inference Optimization
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
+442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0
Shares Web / Edge / On-Device Runtime, Inference Optimization
Run Mixtral-8x7B models in Colab or consumer desktops
-3 (-0.1%) in 30d · Committed 957d ago · Python · MIT
Shares Inference Optimization, Web / Edge / On-Device Runtime
- ROCm/FastFlowLM2.1k
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
+97 (+4.9%) in 30d · Committed today · C++ · Other license
Shares Web / Edge / On-Device Runtime, Inference Optimization
- Language
- C
- License
- -
- Contributors
- 1
- Forks
- 15
- Watchers
- 5
- Open issues
- 2
- Releases
- 0
- Created
- 2026-07-30
- Stars this week
- +0
You've seen where esp32s3-distributed-ai stands today.
Get the moves before everyone else: the 5 Web / Edge / On-Device Runtime repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.