llm-inspector
The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.
helasaoudi/llm-inspector
View on GitHub ↗The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.
llm-inspector grew +0.0% in the last 30 days, ranks 316th of 340 in Observability & Tracing, last commit 54 days ago.
Star trajectory
52 days tracked+0.0% in 30d, below the Observability & Tracing median of +1.1%.
Last commit 54 days ago, staler than the median of 5d.
How it compares in Observability & Tracing
Ranked 316th of 340 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere llm-inspector sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
+0 (+0.0%) in 30d · Committed 849d ago · Shell · MIT
Shares Inference Optimization, Observability & Tracing
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
+170 (+8.9%) in 30d · Committed today · Python · Apache-2.0
Shares Inference Optimization, Observability & Tracing
Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster…
+1 (+0.6%) in 30d · Committed 2d ago · Go · Apache-2.0
Shares Inference Optimization, Observability & Tracing
Data Center and Client workload and software optimizations for Intel hardware.
+7 (+5.3%) in 30d · Committed 12d ago · Shell · Other license
Shares Inference Optimization, Observability & Tracing
LLM Inference analyzer for different hardware platforms
+6 (+4.7%) in 30d · Committed 11d ago · Jupyter Notebook · MIT
Shares Inference Optimization, Observability & Tracing
llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
+1 (+0.8%) in 30d · Committed 498d ago · Python
Shares Inference Optimization, Observability & Tracing
Deploy, monitor, and tune LLM through a visual interface — plus image / video generation on top of ComfyUI.
-2 (-1.9%) in 30d · Committed 15d ago · Python · MIT
Shares Inference Optimization, Observability & Tracing
Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely…
-22 (-41%) in 30d · Committed today · Go · Apache-2.0
Shares Observability & Tracing, Inference Optimization
DMI: A decoupled, asynchronous observability stack for high-performance LLMs.
+0 (+0.0%) in 30d · Committed 16d ago · Python · Apache-2.0
Shares Observability & Tracing, Inference Optimization
Rust profiler for CPU, memory, SQL, HTTP, and async performance, with Prometheus and Grafana support.
+30 (+1.6%) in 30d · Committed today · Rust · MIT
Shares Observability & Tracing, Inference Optimization
- Language
- Python
- License
- MIT License
- Contributors
- 2
- Forks
- 6
- Watchers
- 0
- Open issues
- 0
- Releases
- 2
- Created
- 2026-07-15
- Stars this week
- +0
You've seen where llm-inspector stands today.
Get the moves before everyone else: the 5 Observability & Tracing repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.