StartLux-Prism

Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.

StartLuxLabs/StartLux-Prism

View on GitHub ↗

Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.

StartLux-Prism ranks 128th of 397 in Production Serving & Deployment, last commit 26 days ago.

Star trajectory

24 days tracked
2026-10-29560 stars today2026-11-22
Momentum

- in 30d, below the Production Serving & Deployment median of +1.3%.

Maintenance

Last commit 26 days ago, staler than the median of 3d.

How it compares in Production Serving & Deployment

StartLux-Prism
560
stars
- 30d
commit 26 days ago
Production Serving & Deployment median
272
stars
+1.3% 30d
commit ~3d ago
Leader · vllm
97.3k
stars
+2.2% 30d
commit today

Ranked 128th of 397 by stars.

Ranked by shared tags, then keywords, then stars
  1. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Inference Optimization, Production Serving & Deployment

  2. Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Committed today · C++ · Apache-2.0

    Shares Inference Optimization, Production Serving & Deployment

  3. Run large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090…

    Committed today · C++ · MIT

    Shares Production Serving & Deployment, Inference Optimization

  4. Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the…

    +5 (+7.9%) in 30d · Committed 2d ago · Python · MIT

    Shares Production Serving & Deployment, Inference Optimization

  5. Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory

    Committed today · Go · Apache-2.0

    Shares Production Serving & Deployment, Inference Optimization

  6. A Rust-native LLM serving engine. One binary, no Python runtime.

    +1 (+4.8%) in 30d · Committed today · Rust · MIT

    Shares Production Serving & Deployment, Inference Optimization

  7. Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B) and Hy4-Flash…

    +1.6k (+108%) in 30d · Committed today · Cuda · MIT

    Shares Production Serving & Deployment, Inference Optimization

  8. 一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

    +17 (+0.9%) in 30d · Committed 2d ago · C++ · Apache-2.0

    Shares Production Serving & Deployment, Inference Optimization

  9. A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is…

    +23 (+1.4%) in 30d · Committed today · C++ · Apache-2.0

    Shares Inference Optimization, Production Serving & Deployment

  10. Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    +25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Production Serving & Deployment, Inference Optimization

Language
Python
License
-
Contributors
4
Forks
5
Watchers
0
Open issues
0
Releases
0
Created
2026-10-13
Stars this week
+41

You've seen where StartLux-Prism stands today.

Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain StartLux-Prism?

Claim this page to add your own call-to-action.

Claim this page