magnitude
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
magnitudedev/magnitude
View on GitHub ↗Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
magnitude grew +11.5% in the last 30 days, ranks 35th of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.
Star trajectory
76 days tracked+11.5% in 30d, above the Local Runtime / Inference Engine median of +1.9%.
Last commit today, fresher than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 35th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere magnitude sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
- Osmantic/ODS7.9k
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux…
+235 (+3.1%) in 30d · Committed 2d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Ship to Users
Open-source sandboxes where coding agents build and deploy. Spin up isolated environments where Claude Code…
+4 (+1.3%) in 30d · Committed 4d ago · Python · Other license
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Ship to Users
Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…
+36 (+15%) in 30d · Committed 2d ago · Python · MIT
Shares Production Serving & Deployment, Local Runtime / Inference Engine, Ship to Users
Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
+0 (+0.0%) in 30d · Committed 63d ago · TypeScript
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Ship to Users
- labring/sealos18.4k
Deploy real projects from GitHub or your AI coding agent, then keep them running with AI-powered operations.
+34 (+0.2%) in 30d · Committed yesterday · Go · Other license
Shares Production Serving & Deployment, Local Runtime / Inference Engine, Ship to Users
Community Docker and Kubernetes packaging for DeepSeek Harness (@deepseek-ai/dsh), with a hardened image…
+66 (+55%) in 30d · Committed 3d ago · JavaScript · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Ship to Users
AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models
-1 (-0.6%) in 30d · Committed 934d ago · Shell · OSL-3.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Ship to Users
The production framework for Predictive and Generative AI. Serve any model as an API in one line, with…
+2 (+0.7%) in 30d · Committed yesterday · Python · Apache-2.0
Shares Production Serving & Deployment, Ship to Users
Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point…
+13 (+4.6%) in 30d · Committed 3d ago · TypeScript
Shares Local Runtime / Inference Engine, Production Serving & Deployment
The inference engine the open-source world built for itself.
+6 (+2.5%) in 30d · Committed 56d ago · Python
Shares Local Runtime / Inference Engine, Production Serving & Deployment
- Language
- Rust
- License
- Apache License 2.0
- Contributors
- 13
- Forks
- 583
- Watchers
- 38
- Open issues
- 33
- Releases
- 90
- Created
- 2026-06-12
- Stars this week
- +319
You've seen where magnitude stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.