bindwidth
Evidence-aware on-prem LLM inference sizing and TCO calculator
juxhinr/bindwidth
View on GitHub ↗Evidence-aware on-prem LLM inference sizing and TCO calculator
bindwidth grew -1.8% in the last 30 days, ranks 282nd of 343 in Inference Optimization, last commit 111 days ago.
Star trajectory
82 days tracked-1.8% in 30d, below the Inference Optimization median of +1.6%.
Last commit 111 days ago, staler than the median of 16d.
How it compares in Inference Optimization
Ranked 282nd of 343 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere bindwidth sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Lucebox inference engine for heterogeneous hardware & consumer GPUs
+76 (+2.6%) in 30d · Committed today · C++ · Apache-2.0
Shares Inference Optimization, Production Serving & Deployment
Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention
+342 (+13%) in 30d · Committed 3d ago · Python · Apache-2.0
Shares Inference Optimization, Production Serving & Deployment
- ddalcu/mlx-serve2.6k
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend…
+504 (+25%) in 30d · Committed today · Zig · Other license
Shares Production Serving & Deployment, Inference Optimization
一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
+17 (+0.9%) in 30d · Committed 2d ago · C++ · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization
High Performance Serving Runtime For Interactive Super Intelligence System
+299 (+19%) in 30d · Committed today · Python · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization
- xLLM-AI/xllm1.6k
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is…
+23 (+1.4%) in 30d · Committed today · C++ · Apache-2.0
Shares Inference Optimization, Production Serving & Deployment
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…
+962 (+243%) in 30d · Committed 3d ago · C++ · MIT
Shares Inference Optimization, Production Serving & Deployment
- wici-ai/inferssd1.3k
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
Committed today · C++ · Apache-2.0
Shares Inference Optimization, Production Serving & Deployment
- eagle-hq/EAGLE-41.2k
Official Inference Code of EAGLE-4
+334 (+38%) in 30d · Committed 8d ago · Python · Other license
Shares Inference Optimization, Production Serving & Deployment
TurboOCR, >200 img/s OmnidocBench. TensorRT FP16, PP-OCRv6, HTTP + gRPC
+21 (+1.8%) in 30d · Committed 55d ago · C++ · MIT
Shares Inference Optimization, Production Serving & Deployment
- Language
- JavaScript
- License
- MIT License
- Contributors
- 1
- Forks
- 75
- Watchers
- 0
- Open issues
- 0
- Releases
- 0
- Created
- 2026-08-01
- Stars this week
- +0
You've seen where bindwidth stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.