smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
lightseekorg/smg
View on GitHub ↗Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
smg grew +23.8% in the last 30 days, ranks 47th of 268 in LLM Gateway & Routing, actively maintained, last commit today.
Star trajectory
115 days tracked+23.8% in 30d, above the LLM Gateway & Routing median of +2.1%.
Last commit today, fresher than the median of 5d.
How it compares in LLM Gateway & Routing
Ranked 47th of 268 by stars.
- Language
- Rust
- License
- Apache License 2.0
- Contributors
- 163
- Forks
- 200
- Watchers
- 2
- Open issues
- 78
- Releases
- 19
- Created
- 2025-11-22
- Stars this week
- +59
You've seen where smg stands today.
Get the moves before everyone else: the 5 LLM Gateway & Routing repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.