vllm-metal
Community maintained hardware plugin for vLLM on Apple Silicon
vllm-project/vllm-metal
View on GitHub ↗Community maintained hardware plugin for vLLM on Apple Silicon
vllm-metal grew +5.7% in the last 30 days, ranks 95th of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.
Star trajectory
68 days tracked+5.7% in 30d, above the Local Runtime / Inference Engine median of +1.9%.
Last commit today, fresher than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 95th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere vllm-metal sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…
+34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings
A programmable system for high-performance model serving
Committed today · Rust · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings
A model-agnostic GPU runtime for shipping models as verified programs.
+84 (+63%) in 30d · Committed 2d ago · Rust · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings
AI sovereignty for the world's most trusted runtime.
+21 (+12%) in 30d · Committed yesterday · Java · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings
2bit quants, kernels and runtime for consumer devices.
Committed 16d ago · C++ · Other license
Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
+83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2
Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…
Committed today · C# · BSD-3-Clause
Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings
True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference…
+20 (+9.7%) in 30d · Committed yesterday · Kotlin · Other license
Shares Local Runtime / Inference Engine, Language Bindings, Inference Optimization
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
+442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0
Shares Inference Optimization, Local Runtime / Inference Engine
- wici-ai/inferssd1.3k
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 116
- Forks
- 365
- Watchers
- 9
- Open issues
- 32
- Releases
- 9
- Created
- 2025-12-12
- Stars this week
- +16
You've seen where vllm-metal stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.