vLLM_Inference_Engine

Star history and ranking for TryingtobeingNikhil/vLLM_Inference_Engine.

TryingtobeingNikhil/vLLM_Inference_Engine

View on GitHub ↗

vLLM_Inference_Engine grew +1.9% in the last 30 days, ranks 466th of 539 in Local Runtime / Inference Engine, last commit 48 days ago.

Star trajectory

61 days tracked
2026-09-21105 stars today2026-11-22
Momentum

+1.9% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 48 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

vLLM_Inference_Engine
105
stars
+1.9% 30d
commit 48 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 466th of 539 by stars.

Ranked by shared tags, then keywords, then stars

Where vLLM_Inference_Engine sits

Hover or focus a node for details. Click to open it.

  • This repo
  • Related repo
  • Tag or category
  1. Lucebox inference engine for heterogeneous hardware & consumer GPUs

    +76 (+2.6%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  2. A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is…

    +23 (+1.4%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  3. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  4. Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  5. Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    +25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Production Serving & Deployment, Local Runtime / Inference Engine

  6. Run many AI agents at once on your Mac, up to 3x faster.

    +273 (+91%) in 30d · Committed today · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  7. Xolotl: run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM)…

    +264 (+90%) in 30d · Committed today · C++ · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  8. a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…

    +34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  9. A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with…

    +2 (+0.6%) in 30d · Committed 530d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  10. llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

    +2 (+0.7%) in 30d · Committed 2d ago · Go · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

Language
Python
License
-
Contributors
2
Forks
11
Watchers
1
Open issues
0
Releases
0
Created
2026-06-22
Stars this week
+1

You've seen where vLLM_Inference_Engine stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain vLLM_Inference_Engine?

Claim this page to add your own call-to-action.

Claim this page