pie
A programmable system for high-performance model serving
pie-project/pie
View on GitHub ↗A programmable system for high-performance model serving
pie ranks 213th of 397 in Production Serving & Deployment, actively maintained, last commit today.
Star trajectory
21 days tracked- in 30d, below the Production Serving & Deployment median of +1.3%.
Last commit today, fresher than the median of 3d.
How it compares in Production Serving & Deployment
Ranked 213th of 397 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere pie sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…
Committed today · C# · BSD-3-Clause
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization, Language Bindings
a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…
+34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment, Language Bindings
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…
+962 (+243%) in 30d · Committed 3d ago · C++ · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment
Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in…
Committed today · Rust · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
A Rust-native LLM serving engine. One binary, no Python runtime.
+1 (+4.8%) in 30d · Committed today · Rust · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
Lucebox inference engine for heterogeneous hardware & consumer GPUs
+76 (+2.6%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
+83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2
Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings
- wici-ai/inferssd1.3k
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
+25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization, Local Runtime / Inference Engine
Run many AI agents at once on your Mac, up to 3x faster.
+273 (+91%) in 30d · Committed today · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
- Language
- Rust
- License
- Apache License 2.0
- Contributors
- 24
- Forks
- 41
- Watchers
- 1
- Open issues
- 28
- Releases
- 8
- Created
- 2025-01-21
- Stars this week
- +5
You've seen where pie stands today.
Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.