vllm-metal

Community maintained hardware plugin for vLLM on Apple Silicon

vllm-project/vllm-metal

View on GitHub ↗

Community maintained hardware plugin for vLLM on Apple Silicon

vllm-metal grew +5.7% in the last 30 days, ranks 95th of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.

Star trajectory

68 days tracked
2026-09-142k stars today2026-11-22
Momentum

+5.7% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit today, fresher than the median of 6d.

How it compares in Local Runtime / Inference Engine

vllm-metal
2k
stars
+5.7% 30d
commit today
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 95th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…

    +34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings

  2. A programmable system for high-performance model serving

    Committed today · Rust · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings

  3. A model-agnostic GPU runtime for shipping models as verified programs.

    +84 (+63%) in 30d · Committed 2d ago · Rust · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings

  4. AI sovereignty for the world's most trusted runtime.

    +21 (+12%) in 30d · Committed yesterday · Java · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings

  5. 2bit quants, kernels and runtime for consumer devices.

    Committed 16d ago · C++ · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings

  6. NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

    +83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2

    Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings

  7. A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…

    Committed today · C# · BSD-3-Clause

    Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings

  8. True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference…

    +20 (+9.7%) in 30d · Committed yesterday · Kotlin · Other license

    Shares Local Runtime / Inference Engine, Language Bindings, Inference Optimization

  9. Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    +442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

  10. Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

Language
Python
License
Apache License 2.0
Contributors
116
Forks
365
Watchers
9
Open issues
32
Releases
9
Created
2025-12-12
Stars this week
+16

You've seen where vllm-metal stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain vllm-metal?

Claim this page to add your own call-to-action.

Claim this page