llm-inspector

The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.

helasaoudi/llm-inspector

View on GitHub ↗

The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.

llm-inspector grew +0.0% in the last 30 days, ranks 316th of 340 in Observability & Tracing, last commit 54 days ago.

Star trajectory

52 days tracked
2026-09-3076 stars today2026-11-22
Momentum

+0.0% in 30d, below the Observability & Tracing median of +1.1%.

Maintenance

Last commit 54 days ago, staler than the median of 5d.

How it compares in Observability & Tracing

llm-inspector
76
stars
+0.0% 30d
commit 54 days ago
Observability & Tracing median
322
stars
+1.1% 30d
commit ~5d ago
Leader · langfuse
37.7k
stars
+4.1% 30d
commit today

Ranked 316th of 340 by stars.

Ranked by shared tags, then keywords, then stars
  1. 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.

    +0 (+0.0%) in 30d · Committed 849d ago · Shell · MIT

    Shares Inference Optimization, Observability & Tracing

  2. Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

    +170 (+8.9%) in 30d · Committed today · Python · Apache-2.0

    Shares Inference Optimization, Observability & Tracing

  3. Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster…

    +1 (+0.6%) in 30d · Committed 2d ago · Go · Apache-2.0

    Shares Inference Optimization, Observability & Tracing

  4. Data Center and Client workload and software optimizations for Intel hardware.

    +7 (+5.3%) in 30d · Committed 12d ago · Shell · Other license

    Shares Inference Optimization, Observability & Tracing

  5. LLM Inference analyzer for different hardware platforms

    +6 (+4.7%) in 30d · Committed 11d ago · Jupyter Notebook · MIT

    Shares Inference Optimization, Observability & Tracing

  6. llm theoretical performance analysis tools and support params, flops, memory and latency analysis.

    +1 (+0.8%) in 30d · Committed 498d ago · Python

    Shares Inference Optimization, Observability & Tracing

  7. Deploy, monitor, and tune LLM through a visual interface — plus image / video generation on top of ComfyUI.

    -2 (-1.9%) in 30d · Committed 15d ago · Python · MIT

    Shares Inference Optimization, Observability & Tracing

  8. Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely…

    -22 (-41%) in 30d · Committed today · Go · Apache-2.0

    Shares Observability & Tracing, Inference Optimization

  9. DMI: A decoupled, asynchronous observability stack for high-performance LLMs.

    +0 (+0.0%) in 30d · Committed 16d ago · Python · Apache-2.0

    Shares Observability & Tracing, Inference Optimization

  10. Rust profiler for CPU, memory, SQL, HTTP, and async performance, with Prometheus and Grafana support.

    +30 (+1.6%) in 30d · Committed today · Rust · MIT

    Shares Observability & Tracing, Inference Optimization

Language
Python
License
MIT License
Contributors
2
Forks
6
Watchers
0
Open issues
0
Releases
2
Created
2026-07-15
Stars this week
+0

You've seen where llm-inspector stands today.

Get the moves before everyone else: the 5 Observability & Tracing repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain llm-inspector?

Claim this page to add your own call-to-action.

Claim this page