resin
🧱 Experimental library for building inference engines
ekzhang/resin
View on GitHub ↗🧱 Experimental library for building inference engines
resin ranks 113th of 343 in Inference Optimization, actively maintained, last commit today.
Star trajectory
25 days tracked- in 30d, below the Inference Optimization median of +1.6%.
Last commit today, fresher than the median of 16d.
How it compares in Inference Optimization
Ranked 113th of 343 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere resin sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
+25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization, Distributed Inference
A high-performance inference system for large language models, designed for production environments.
-1 (-0.2%) in 30d · Committed 338d ago · C++ · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization, Distributed Inference
- ahtx/kindi198
Kindi 0.6.1: fast local LLM inference on low-cost GPUs and CPUs. DeepSeek-V4.1-Flash (552B) at 18.7 tok/s on…
Committed 5d ago · Python · AGPL-3.0
Shares Production Serving & Deployment, Distributed Inference, Inference Optimization
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs…
+3 (+0.6%) in 30d · Committed 320d ago · Python · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization, Distributed Inference
Accelerate inference without tears
-1 (-0.3%) in 30d · Committed 303d ago · Python · MIT
Shares Inference Optimization, Production Serving & Deployment, Distributed Inference
Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster…
+1 (+0.6%) in 30d · Committed 2d ago · Go · Apache-2.0
Shares Distributed Inference, Production Serving & Deployment, Inference Optimization
DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context)…
+27 (+19%) in 30d · Committed 26d ago · Python · MIT
Shares Production Serving & Deployment, Distributed Inference, Inference Optimization
Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service…
-1 (-0.6%) in 30d · Committed 349d ago · Python · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization, Distributed Inference
Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.
+9 (+9.2%) in 30d · Committed today · Python · Apache-2.0
Shares Production Serving & Deployment, Distributed Inference, Inference Optimization
Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely…
-22 (-41%) in 30d · Committed today · Go · Apache-2.0
Shares Production Serving & Deployment, Distributed Inference, Inference Optimization
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 6
- Forks
- 42
- Watchers
- 3
- Open issues
- 2
- Releases
- 0
- Created
- 2026-08-08
- Stars this week
- +11
You've seen where resin stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.