esp32s3-distributed-ai

Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully offline.

wladimiravila/esp32s3-distributed-ai

View on GitHub ↗

Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully offline.

esp32s3-distributed-ai grew +7.1% in the last 30 days, ranks 151st of 177 in Web / Edge / On-Device Runtime, last commit 114 days ago.

Star trajectory

82 days tracked
2026-08-31120 stars today2026-11-22
Momentum

+7.1% in 30d, above the Web / Edge / On-Device Runtime median of +1.8%.

Maintenance

Last commit 114 days ago, staler than the median of 6d.

How it compares in Web / Edge / On-Device Runtime

esp32s3-distributed-ai
120
stars
+7.1% 30d
commit 114 days ago
Web / Edge / On-Device Runtime median
311
stars
+1.8% 30d
commit ~6d ago
Leader · mlc-llm
23.4k
stars
+0.8% 30d
commit today

Ranked 151st of 177 by stars.

Ranked by shared tags, then keywords, then stars
  1. Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding…

    +56 (+9.3%) in 30d · Committed 19d ago · JavaScript · MIT

    Shares Web / Edge / On-Device Runtime, Distributed Inference, Inference Optimization

  2. Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac…

    +1 (+0.7%) in 30d · Committed 36d ago · Python · Apache-2.0

    Shares Distributed Inference, Inference Optimization, Web / Edge / On-Device Runtime

  3. [Official] Prima.cpp: Scale Your Local AI Beyond One Device.

    +20 (+18%) in 30d · Committed 76d ago · C++ · MIT

    Shares Distributed Inference, Web / Edge / On-Device Runtime, Inference Optimization

  4. JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs…

    +3 (+0.6%) in 30d · Committed 320d ago · Python · Apache-2.0

    Shares Inference Optimization, Distributed Inference

  5. Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream…

    +6 (+1.5%) in 30d · Committed 87d ago · Shell · MIT

    Shares Inference Optimization, Distributed Inference

  6. SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7…

    +9 (+3.9%) in 30d · Committed 81d ago · Rust · Other license

    Shares Inference Optimization, Distributed Inference

  7. DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context)…

    +27 (+19%) in 30d · Committed 26d ago · Python · MIT

    Shares Distributed Inference, Inference Optimization

  8. Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    +442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0

    Shares Web / Edge / On-Device Runtime, Inference Optimization

  9. Run Mixtral-8x7B models in Colab or consumer desktops

    -3 (-0.1%) in 30d · Committed 957d ago · Python · MIT

    Shares Inference Optimization, Web / Edge / On-Device Runtime

  10. Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

    +97 (+4.9%) in 30d · Committed today · C++ · Other license

    Shares Web / Edge / On-Device Runtime, Inference Optimization

Language
C
License
-
Contributors
1
Forks
15
Watchers
5
Open issues
2
Releases
0
Created
2026-07-30
Stars this week
+0

You've seen where esp32s3-distributed-ai stands today.

Get the moves before everyone else: the 5 Web / Edge / On-Device Runtime repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain esp32s3-distributed-ai?

Claim this page to add your own call-to-action.

Claim this page