StartLux-Prism
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
StartLuxLabs/StartLux-Prism
View on GitHub ↗Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
StartLux-Prism ranks 128th of 397 in Production Serving & Deployment, last commit 26 days ago.
Star trajectory
24 days tracked- in 30d, below the Production Serving & Deployment median of +1.3%.
Last commit 26 days ago, staler than the median of 3d.
How it compares in Production Serving & Deployment
Ranked 128th of 397 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere StartLux-Prism sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…
+962 (+243%) in 30d · Committed 3d ago · C++ · MIT
Shares Inference Optimization, Production Serving & Deployment
- wici-ai/inferssd1.3k
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
Committed today · C++ · Apache-2.0
Shares Inference Optimization, Production Serving & Deployment
Run large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090…
Committed today · C++ · MIT
Shares Production Serving & Deployment, Inference Optimization
Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the…
+5 (+7.9%) in 30d · Committed 2d ago · Python · MIT
Shares Production Serving & Deployment, Inference Optimization
Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory
Committed today · Go · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization
A Rust-native LLM serving engine. One binary, no Python runtime.
+1 (+4.8%) in 30d · Committed today · Rust · MIT
Shares Production Serving & Deployment, Inference Optimization
Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B) and Hy4-Flash…
+1.6k (+108%) in 30d · Committed today · Cuda · MIT
Shares Production Serving & Deployment, Inference Optimization
一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
+17 (+0.9%) in 30d · Committed 2d ago · C++ · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization
- xLLM-AI/xllm1.6k
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is…
+23 (+1.4%) in 30d · Committed today · C++ · Apache-2.0
Shares Inference Optimization, Production Serving & Deployment
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
+25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization
- Language
- Python
- License
- -
- Contributors
- 4
- Forks
- 5
- Watchers
- 0
- Open issues
- 0
- Releases
- 0
- Created
- 2026-10-13
- Stars this week
- +41
You've seen where StartLux-Prism stands today.
Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.