light-vllm
A small, composable LLM inference runtime built around explicit contracts.
poorpaper/light-vllm
View on GitHub ↗A small, composable LLM inference runtime built around explicit contracts.
light-vllm grew +0.0% in the last 30 days, ranks 475th of 539 in Local Runtime / Inference Engine, last commit 83 days ago.
Star trajectory
57 days tracked+0.0% in 30d, below the Local Runtime / Inference Engine median of +1.9%.
Last commit 83 days ago, staler than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 475th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere light-vllm sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…
+962 (+243%) in 30d · Committed 3d ago · C++ · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment
A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with…
+2 (+0.6%) in 30d · Committed 530d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
Aggregates compute from spare GPU capacity
+2 (+0.9%) in 30d · Committed 3d ago · TypeScript · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
- ahtx/kindi198
Kindi 0.6.1: fast local LLM inference on low-cost GPUs and CPUs. DeepSeek-V4.1-Flash (552B) at 18.7 tok/s on…
Committed 5d ago · Python · AGPL-3.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
Serving Inside Pytorch
+1 (+0.6%) in 30d · Committed 152d ago · Python · Apache-2.0
Shares Production Serving & Deployment, Local Runtime / Inference Engine
An open-source virtual AI Infra team that discovers, benchmarks, and safely upgrades local LLM inference—with…
-1 (-1.2%) in 30d · Committed 74d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI…
+3 (+4.1%) in 30d · Committed 41d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the…
+5 (+7.9%) in 30d · Committed 2d ago · Python · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each…
+838 (+11%) in 30d · Committed today · Rust · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
Lucebox inference engine for heterogeneous hardware & consumer GPUs
+76 (+2.6%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment
- Language
- Python
- License
- -
- Contributors
- 1
- Forks
- 2
- Watchers
- 1
- Open issues
- 0
- Releases
- 0
- Created
- 2026-08-09
- Stars this week
- +0
You've seen where light-vllm stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.