IRON

Close-to-metal Python API for AMD Ryzen™ AI NPUs, built on MLIR-AIE: declare operators, compile them into graphs, autotune them, and run models entirely on the NPU.

Close-to-metal Python API for AMD Ryzen™ AI NPUs, built on MLIR-AIE: declare operators, compile them into graphs, autotune them, and run models entirely on the NPU.

IRON ranks 127th of 177 in Web / Edge / On-Device Runtime, actively maintained, last commit today.

Star trajectory

18 days tracked
2026-11-04158 stars today2026-11-22
Momentum

- in 30d, below the Web / Edge / On-Device Runtime median of +1.8%.

Maintenance

Last commit today, fresher than the median of 6d.

How it compares in Web / Edge / On-Device Runtime

IRON
158
stars
- 30d
commit today
Web / Edge / On-Device Runtime median
311
stars
+1.8% 30d
commit ~6d ago
Leader · mlc-llm
23.4k
stars
+0.8% 30d
commit today

Ranked 127th of 177 by stars.

Ranked by shared tags, then keywords, then stars
  1. NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

    +83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2

    Shares Web / Edge / On-Device Runtime, Inference Optimization, Language Bindings

  2. 2bit quants, kernels and runtime for consumer devices.

    Committed 16d ago · C++ · Other license

    Shares Web / Edge / On-Device Runtime, Inference Optimization, Language Bindings

  3. A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…

    Committed today · C# · BSD-3-Clause

    Shares Inference Optimization, Web / Edge / On-Device Runtime, Language Bindings

  4. True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference…

    +20 (+9.7%) in 30d · Committed yesterday · Kotlin · Other license

    Shares Web / Edge / On-Device Runtime, Language Bindings, Inference Optimization

  5. Fast ML inference & training for ONNX models in Rust

    +45 (+1.7%) in 30d · Committed today · Rust · Apache-2.0

    Shares Language Bindings, Web / Edge / On-Device Runtime, Inference Optimization

  6. MindSpore + 🤗Huggingface: Run any Transformers/Diffusers model on MindSpore with seamless compatibility and…

    +1 (+0.1%) in 30d · Committed 82d ago · Python · Apache-2.0

    Shares Language Bindings, Inference Optimization

  7. a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…

    +34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0

    Shares Inference Optimization, Language Bindings

  8. Real-time multimodal AI pipelines on Apple Silicon

    +43 (+20%) in 30d · Committed today · C++ · Apache-2.0

    Shares Web / Edge / On-Device Runtime, Inference Optimization

  9. ⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.

    +0 (+0.0%) in 30d · Committed 896d ago · Python · Apache-2.0

    Shares Inference Optimization, Web / Edge / On-Device Runtime

  10. Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    +442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0

    Shares Web / Edge / On-Device Runtime, Inference Optimization

Language
Python
License
Apache License 2.0
Contributors
19
Forks
58
Watchers
6
Open issues
9
Releases
1
Created
2025-09-19
Stars this week
+1

You've seen where IRON stands today.

Get the moves before everyone else: the 5 Web / Edge / On-Device Runtime repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain IRON?

Claim this page to add your own call-to-action.

Claim this page