pie

A programmable system for high-performance model serving

pie-project/pie

View on GitHub ↗

A programmable system for high-performance model serving

pie ranks 213th of 397 in Production Serving & Deployment, actively maintained, last commit today.

Star trajectory

21 days tracked
2026-11-01245 stars today2026-11-22
Momentum

- in 30d, below the Production Serving & Deployment median of +1.3%.

Maintenance

Last commit today, fresher than the median of 3d.

How it compares in Production Serving & Deployment

pie
245
stars
- 30d
commit today
Production Serving & Deployment median
272
stars
+1.3% 30d
commit ~3d ago
Leader · vllm
97.3k
stars
+2.2% 30d
commit today

Ranked 213th of 397 by stars.

Ranked by shared tags, then keywords, then stars
  1. A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…

    Committed today · C# · BSD-3-Clause

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization, Language Bindings

  2. a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…

    +34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment, Language Bindings

  3. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment

  4. Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in…

    Committed today · Rust · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization

  5. A Rust-native LLM serving engine. One binary, no Python runtime.

    +1 (+4.8%) in 30d · Committed today · Rust · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization

  6. Lucebox inference engine for heterogeneous hardware & consumer GPUs

    +76 (+2.6%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment

  7. NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

    +83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2

    Shares Local Runtime / Inference Engine, Inference Optimization, Language Bindings

  8. Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment

  9. Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    +25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Production Serving & Deployment, Inference Optimization, Local Runtime / Inference Engine

  10. Run many AI agents at once on your Mac, up to 3x faster.

    +273 (+91%) in 30d · Committed today · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization

Language
Rust
License
Apache License 2.0
Contributors
24
Forks
41
Watchers
1
Open issues
28
Releases
8
Created
2025-01-21
Stars this week
+5

You've seen where pie stands today.

Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain pie?

Claim this page to add your own call-to-action.

Claim this page