auto

the agi compiler: records llm agent behavior, proves what repeats, and compiles it into verified, sandboxed wasm binaries that run for microdollars. nothing figured out twice, paper: https://arxiv.org/abs/2607.04542

RightNow-AI/auto

View on GitHub ↗

the agi compiler: records llm agent behavior, proves what repeats, and compiles it into verified, sandboxed wasm binaries that run for microdollars. nothing figured out twice, paper: https://arxiv.org/abs/2607.04542

auto grew +1.6% in the last 30 days, ranks 255th of 343 in Inference Optimization, last commit 137 days ago.

Star trajectory

82 days tracked
2026-08-31131 stars today2026-11-22
Momentum

+1.6% in 30d, below the Inference Optimization median of +1.6%.

Maintenance

Last commit 137 days ago, staler than the median of 16d.

How it compares in Inference Optimization

auto
131
stars
+1.6% 30d
commit 137 days ago
Inference Optimization median
242
stars
+1.6% 30d
commit ~16d ago
Leader · supertonic
13.8k
stars
-0.1% 30d
commit 74 days ago

Ranked 255th of 343 by stars.

Ranked by shared tags, then keywords, then stars
  1. Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    +442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0

    Shares Web / Edge / On-Device Runtime, Inference Optimization

  2. 2bit quants, kernels and runtime for consumer devices.

    Committed 16d ago · C++ · Other license

    Shares Web / Edge / On-Device Runtime, Inference Optimization

  3. An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice…

    +696 (+19%) in 30d · Committed today · C++ · Other license

    Shares Web / Edge / On-Device Runtime, Inference Optimization

  4. A high-performance inference engine for AI models

    +837 (+33%) in 30d · Committed today · Rust · MIT

    Shares Inference Optimization, Web / Edge / On-Device Runtime

  5. The fastest way to run Inkling 2 Mini, Qwen 3.8 and Ternary Bonsai 2 27B on a Mac: Inkling 2 Mini at up to…

    +107 (+4.1%) in 30d · Committed today · Python · Apache-2.0

    Shares Inference Optimization, Web / Edge / On-Device Runtime

  6. Run Mixtral-8x7B models in Colab or consumer desktops

    -3 (-0.1%) in 30d · Committed 957d ago · Python · MIT

    Shares Inference Optimization, Web / Edge / On-Device Runtime

  7. Run a 1-billion parameter LLM on a $10 board with 256MB RAM

    +6 (+0.3%) in 30d · Committed 272d ago · C · MIT

    Shares Web / Edge / On-Device Runtime, Inference Optimization

  8. Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

    +97 (+4.9%) in 30d · Committed today · C++ · Other license

    Shares Web / Edge / On-Device Runtime, Inference Optimization

  9. NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

    +83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2

    Shares Web / Edge / On-Device Runtime, Inference Optimization

  10. Fast Multimodal LLM on Mobile Devices

    +15 (+0.9%) in 30d · Committed 52d ago · C++ · MIT

    Shares Web / Edge / On-Device Runtime, Inference Optimization

Language
Rust
License
Apache License 2.0
Contributors
1
Forks
13
Watchers
0
Open issues
0
Releases
0
Created
2026-07-05
Stars this week
+0

You've seen where auto stands today.

Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain auto?

Claim this page to add your own call-to-action.

Claim this page