light-vllm

A small, composable LLM inference runtime built around explicit contracts.

poorpaper/light-vllm

View on GitHub ↗

A small, composable LLM inference runtime built around explicit contracts.

light-vllm grew +0.0% in the last 30 days, ranks 475th of 539 in Local Runtime / Inference Engine, last commit 83 days ago.

Star trajectory

57 days tracked
2026-09-25101 stars today2026-11-22
Momentum

+0.0% in 30d, below the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 83 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

light-vllm
101
stars
+0.0% 30d
commit 83 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 475th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  2. A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with…

    +2 (+0.6%) in 30d · Committed 530d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  3. Aggregates compute from spare GPU capacity

    +2 (+0.9%) in 30d · Committed 3d ago · TypeScript · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  4. Kindi 0.6.1: fast local LLM inference on low-cost GPUs and CPUs. DeepSeek-V4.1-Flash (552B) at 18.7 tok/s on…

    Committed 5d ago · Python · AGPL-3.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  5. Serving Inside Pytorch

    +1 (+0.6%) in 30d · Committed 152d ago · Python · Apache-2.0

    Shares Production Serving & Deployment, Local Runtime / Inference Engine

  6. An open-source virtual AI Infra team that discovers, benchmarks, and safely upgrades local LLM inference—with…

    -1 (-1.2%) in 30d · Committed 74d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  7. Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI…

    +3 (+4.1%) in 30d · Committed 41d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  8. Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the…

    +5 (+7.9%) in 30d · Committed 2d ago · Python · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  9. Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each…

    +838 (+11%) in 30d · Committed today · Rust · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

  10. Lucebox inference engine for heterogeneous hardware & consumer GPUs

    +76 (+2.6%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment

Language
Python
License
-
Contributors
1
Forks
2
Watchers
1
Open issues
0
Releases
0
Created
2026-08-09
Stars this week
+0

You've seen where light-vllm stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain light-vllm?

Claim this page to add your own call-to-action.

Claim this page