nano-vllm-v1
Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill
slwang-ustc/nano-vllm-v1
View on GitHub ↗Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill
nano-vllm-v1 grew +4.0% in the last 30 days, ranks 468th of 539 in Local Runtime / Inference Engine, last commit 299 days ago.
Star trajectory
50 days tracked+4.0% in 30d, above the Local Runtime / Inference Engine median of +1.9%.
Last commit 299 days ago, staler than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 468th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere nano-vllm-v1 sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Lucebox inference engine for heterogeneous hardware & consumer GPUs
+76 (+2.6%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…
+962 (+243%) in 30d · Committed 3d ago · C++ · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment
Xolotl: run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM)…
+264 (+90%) in 30d · Committed today · C++ · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over…
+10 (+1.8%) in 30d · Committed yesterday · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above…
+10 (+2.0%) in 30d · Committed 152d ago · Python · Apache-2.0
Shares Inference Optimization, Local Runtime / Inference Engine, Production Serving & Deployment
lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.
+43 (+14%) in 30d · Committed 31d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.
+2 (+0.7%) in 30d · Committed 2d ago · Go · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment
Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…
+36 (+15%) in 30d · Committed 2d ago · Python · MIT
Shares Production Serving & Deployment, Local Runtime / Inference Engine, Inference Optimization
A programmable system for high-performance model serving
Committed today · Rust · Apache-2.0
Shares Production Serving & Deployment, Local Runtime / Inference Engine, Inference Optimization
run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and…
+31 (+19%) in 30d · Committed 35d ago · Python
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
- Language
- Python
- License
- MIT License
- Contributors
- 1
- Forks
- 27
- Watchers
- 0
- Open issues
- 2
- Releases
- 0
- Created
- 2026-01-22
- Stars this week
- +1
You've seen where nano-vllm-v1 stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.