resin

🧱 Experimental library for building inference engines

ekzhang/resin

View on GitHub ↗

🧱 Experimental library for building inference engines

resin ranks 113th of 343 in Inference Optimization, actively maintained, last commit today.

Star trajectory

25 days tracked
2026-10-28445 stars today2026-11-22
Momentum

- in 30d, below the Inference Optimization median of +1.6%.

Maintenance

Last commit today, fresher than the median of 16d.

How it compares in Inference Optimization

resin
445
stars
- 30d
commit today
Inference Optimization median
242
stars
+1.6% 30d
commit ~16d ago
Leader · supertonic
13.8k
stars
-0.1% 30d
commit 74 days ago

Ranked 113th of 343 by stars.

Ranked by shared tags, then keywords, then stars
  1. Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    +25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Production Serving & Deployment, Inference Optimization, Distributed Inference

  2. A high-performance inference system for large language models, designed for production environments.

    -1 (-0.2%) in 30d · Committed 338d ago · C++ · Apache-2.0

    Shares Production Serving & Deployment, Inference Optimization, Distributed Inference

  3. Kindi 0.6.1: fast local LLM inference on low-cost GPUs and CPUs. DeepSeek-V4.1-Flash (552B) at 18.7 tok/s on…

    Committed 5d ago · Python · AGPL-3.0

    Shares Production Serving & Deployment, Distributed Inference, Inference Optimization

  4. JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs…

    +3 (+0.6%) in 30d · Committed 320d ago · Python · Apache-2.0

    Shares Production Serving & Deployment, Inference Optimization, Distributed Inference

  5. Accelerate inference without tears

    -1 (-0.3%) in 30d · Committed 303d ago · Python · MIT

    Shares Inference Optimization, Production Serving & Deployment, Distributed Inference

  6. Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster…

    +1 (+0.6%) in 30d · Committed 2d ago · Go · Apache-2.0

    Shares Distributed Inference, Production Serving & Deployment, Inference Optimization

  7. DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context)…

    +27 (+19%) in 30d · Committed 26d ago · Python · MIT

    Shares Production Serving & Deployment, Distributed Inference, Inference Optimization

  8. Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service…

    -1 (-0.6%) in 30d · Committed 349d ago · Python · Apache-2.0

    Shares Production Serving & Deployment, Inference Optimization, Distributed Inference

  9. Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.

    +9 (+9.2%) in 30d · Committed today · Python · Apache-2.0

    Shares Production Serving & Deployment, Distributed Inference, Inference Optimization

  10. Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely…

    -22 (-41%) in 30d · Committed today · Go · Apache-2.0

    Shares Production Serving & Deployment, Distributed Inference, Inference Optimization

Language
Python
License
Apache License 2.0
Contributors
6
Forks
42
Watchers
3
Open issues
2
Releases
0
Created
2026-08-08
Stars this week
+11

You've seen where resin stands today.

Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain resin?

Claim this page to add your own call-to-action.

Claim this page