vLLM_Inference_Engine
Star history and ranking for TryingtobeingNikhil/vLLM_Inference_Engine.
TryingtobeingNikhil/vLLM_Inference_Engine
View on GitHub ↗vLLM_Inference_Engine grew +1.9% in the last 30 days, ranks 466th of 539 in Local Runtime / Inference Engine, last commit 48 days ago.
Star trajectory
61 days tracked+1.9% in 30d, above the Local Runtime / Inference Engine median of +1.9%.
Last commit 48 days ago, staler than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 466th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere vLLM_Inference_Engine sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Lucebox inference engine for heterogeneous hardware & consumer GPUs
+76 (+2.6%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
- xLLM-AI/xllm1.6k
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is…
+23 (+1.4%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…
+962 (+243%) in 30d · Committed 3d ago · C++ · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment
- wici-ai/inferssd1.3k
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
+25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Production Serving & Deployment, Local Runtime / Inference Engine
Run many AI agents at once on your Mac, up to 3x faster.
+273 (+91%) in 30d · Committed today · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
Xolotl: run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM)…
+264 (+90%) in 30d · Committed today · C++ · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment
a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…
+34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with…
+2 (+0.6%) in 30d · Committed 530d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.
+2 (+0.7%) in 30d · Committed 2d ago · Go · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment
- Language
- Python
- License
- -
- Contributors
- 2
- Forks
- 11
- Watchers
- 1
- Open issues
- 0
- Releases
- 0
- Created
- 2026-06-22
- Stars this week
- +1
You've seen where vLLM_Inference_Engine stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.