sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
sgl-project/sglang
View on GitHub ↗SGLang is a high-performance serving framework for large language models and multimodal models.
sglang grew +4.5% in the last 30 days, ranks 7th of 370 in Production Serving & Deployment, actively maintained, last commit today.
Star trajectory
140 days tracked+4.5% in 30d, above the Production Serving & Deployment median of +1.2%.
Last commit today, fresher than the median of 3.5d.
How it compares in Production Serving & Deployment
Ranked 7th of 370 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere sglang sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
- vllm-project/vllm96.9k
A high-throughput and memory-efficient inference and serving engine for LLMs
+3.1k (+3.3%) in 30d · Committed today · Python · Apache-2.0
Shares Production Serving & Deployment
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude…
+10.5k (+14%) in 30d · Committed today · TypeScript · MIT
Shares Production Serving & Deployment
- BerriAI/litellm63.2k
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format…
+2k (+3.2%) in 30d · Committed today · Python · Other license
Shares Production Serving & Deployment
Wrap Antigravity, ChatGPT Codex, Claude Code, Grok Build, Muse Code, Devin as an OpenAI/Gemini/Claude/Codex…
+3.2k (+5.8%) in 30d · Committed today · Go · MIT
Shares Production Serving & Deployment
- QuantumNous/new-api51.9k
Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model…
+1.9k (+3.8%) in 30d · Committed today · Go · AGPL-3.0
Shares Production Serving & Deployment
Sub2API 一站式开源中转服务,让 Claude、Openai 、Gemini、Grok订阅统一接入,支持拼车共享,更高效分摊成本,原生工具无缝使用。
+1.9k (+4.4%) in 30d · Committed today · Go · LGPL-3.0
Shares Production Serving & Deployment
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker…
+322 (+1.6%) in 30d · Committed today · Python · MIT
Shares Production Serving & Deployment
- labring/sealos18.4k
Deploy real projects from GitHub or your AI coding agent, then keep them running with AI-powered operations.
+21 (+0.1%) in 30d · Committed yesterday · Go · Other license
Shares Production Serving & Deployment
Nano vLLM
+585 (+3.7%) in 30d · Committed 202d ago · Python · MIT
Shares Production Serving & Deployment
The Cloud Native AI Platform
+55 (+0.3%) in 30d · Committed 44d ago · Apache-2.0
Shares Production Serving & Deployment
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 2,273
- Forks
- 10.5k
- Watchers
- 184
- Open issues
- 978
- Releases
- 64
- Created
- 2024-01-08
- Stars this week
- +301
You've seen where sglang stands today.
Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.