IRON
Close-to-metal Python API for AMD Ryzen™ AI NPUs, built on MLIR-AIE: declare operators, compile them into graphs, autotune them, and run models entirely on the NPU.
amd/IRON
View on GitHub ↗Close-to-metal Python API for AMD Ryzen™ AI NPUs, built on MLIR-AIE: declare operators, compile them into graphs, autotune them, and run models entirely on the NPU.
IRON ranks 127th of 177 in Web / Edge / On-Device Runtime, actively maintained, last commit today.
Star trajectory
18 days tracked- in 30d, below the Web / Edge / On-Device Runtime median of +1.8%.
Last commit today, fresher than the median of 6d.
How it compares in Web / Edge / On-Device Runtime
Ranked 127th of 177 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere IRON sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
+83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2
Shares Web / Edge / On-Device Runtime, Inference Optimization, Language Bindings
2bit quants, kernels and runtime for consumer devices.
Committed 16d ago · C++ · Other license
Shares Web / Edge / On-Device Runtime, Inference Optimization, Language Bindings
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…
Committed today · C# · BSD-3-Clause
Shares Inference Optimization, Web / Edge / On-Device Runtime, Language Bindings
True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference…
+20 (+9.7%) in 30d · Committed yesterday · Kotlin · Other license
Shares Web / Edge / On-Device Runtime, Language Bindings, Inference Optimization
- pykeio/ort2.6k
Fast ML inference & training for ONNX models in Rust
+45 (+1.7%) in 30d · Committed today · Rust · Apache-2.0
Shares Language Bindings, Web / Edge / On-Device Runtime, Inference Optimization
MindSpore + 🤗Huggingface: Run any Transformers/Diffusers model on MindSpore with seamless compatibility and…
+1 (+0.1%) in 30d · Committed 82d ago · Python · Apache-2.0
Shares Language Bindings, Inference Optimization
a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…
+34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0
Shares Inference Optimization, Language Bindings
Real-time multimodal AI pipelines on Apple Silicon
+43 (+20%) in 30d · Committed today · C++ · Apache-2.0
Shares Web / Edge / On-Device Runtime, Inference Optimization
⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
+0 (+0.0%) in 30d · Committed 896d ago · Python · Apache-2.0
Shares Inference Optimization, Web / Edge / On-Device Runtime
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
+442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0
Shares Web / Edge / On-Device Runtime, Inference Optimization
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 19
- Forks
- 58
- Watchers
- 6
- Open issues
- 9
- Releases
- 1
- Created
- 2025-09-19
- Stars this week
- +1
You've seen where IRON stands today.
Get the moves before everyone else: the 5 Web / Edge / On-Device Runtime repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.