magnitude

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

magnitudedev/magnitude

View on GitHub ↗

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

magnitude grew +11.5% in the last 30 days, ranks 35th of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.

Star trajectory

76 days tracked
2026-09-068.1k stars today2026-11-22
Momentum

+11.5% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit today, fresher than the median of 6d.

How it compares in Local Runtime / Inference Engine

magnitude
8.1k
stars
+11.5% 30d
commit today
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 35th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux…

    +235 (+3.1%) in 30d · Committed 2d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Ship to Users

  2. Open-source sandboxes where coding agents build and deploy. Spin up isolated environments where Claude Code…

    +4 (+1.3%) in 30d · Committed 4d ago · Python · Other license

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Ship to Users

  3. Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…

    +36 (+15%) in 30d · Committed 2d ago · Python · MIT

    Shares Production Serving & Deployment, Local Runtime / Inference Engine, Ship to Users

  4. Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

    +0 (+0.0%) in 30d · Committed 63d ago · TypeScript

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Ship to Users

  5. Deploy real projects from GitHub or your AI coding agent, then keep them running with AI-powered operations.

    +34 (+0.2%) in 30d · Committed yesterday · Go · Other license

    Shares Production Serving & Deployment, Local Runtime / Inference Engine, Ship to Users

  6. Community Docker and Kubernetes packaging for DeepSeek Harness (@deepseek-ai/dsh), with a hardened image…

    +66 (+55%) in 30d · Committed 3d ago · JavaScript · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Ship to Users

  7. AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models

    -1 (-0.6%) in 30d · Committed 934d ago · Shell · OSL-3.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Ship to Users

  8. The production framework for Predictive and Generative AI. Serve any model as an API in one line, with…

    +2 (+0.7%) in 30d · Committed yesterday · Python · Apache-2.0

    Shares Production Serving & Deployment, Ship to Users

  9. Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point…

    +13 (+4.6%) in 30d · Committed 3d ago · TypeScript

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  10. The inference engine the open-source world built for itself.

    +6 (+2.5%) in 30d · Committed 56d ago · Python

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

Language
Rust
License
Apache License 2.0
Contributors
13
Forks
583
Watchers
38
Open issues
33
Releases
90
Created
2026-06-12
Stars this week
+319

You've seen where magnitude stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain magnitude?

Claim this page to add your own call-to-action.

Claim this page