tools
Tools, ComfyUI workflows and benchmark configs from a 4x RTX 3090 local-inference rig
alesha-pro/tools
View on GitHub ↗Tools, ComfyUI workflows and benchmark configs from a 4x RTX 3090 local-inference rig
tools grew +2.2% in the last 30 days, ranks 195th of 539 in Local Runtime / Inference Engine, last commit 54 days ago.
Star trajectory
64 days tracked+2.2% in 30d, above the Local Runtime / Inference Engine median of +1.9%.
Last commit 54 days ago, staler than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 195th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere tools sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
[ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation
-1 (-0.4%) in 30d · Committed 705d ago · Python · Apache-2.0
Shares Inference Optimization, Local Runtime / Inference Engine
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
+442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0
Shares Inference Optimization, Local Runtime / Inference Engine
- trymirai/uzu3.4k
A high-performance inference engine for AI models
+837 (+33%) in 30d · Committed today · Rust · MIT
Shares Local Runtime / Inference Engine, Inference Optimization
Lucebox inference engine for heterogeneous hardware & consumer GPUs
+76 (+2.6%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization
- syv-ai/HyperQwen2.8k
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127…
+592 (+27%) in 30d · Committed 12d ago · Python · Apache-2.0
Shares Inference Optimization, Local Runtime / Inference Engine
- ROCm/FastFlowLM2.1k
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
+97 (+4.9%) in 30d · Committed today · C++ · Other license
Shares Local Runtime / Inference Engine, Inference Optimization
Community maintained hardware plugin for vLLM on Apple Silicon
+109 (+5.7%) in 30d · Committed today · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization
- xLLM-AI/xllm1.6k
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is…
+23 (+1.4%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization
Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models…
+341 (+32%) in 30d · Committed 3d ago · Shell · Other license
Shares Local Runtime / Inference Engine, Inference Optimization
Zero-GPU CPU inference for 30B-284B MoE models (Qwen3.8 176.5B cold-cache certified in 28.26/48.35 GiB Cgroup…
Committed today · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization
- Language
- HTML
- License
- MIT License
- Contributors
- 4
- Forks
- 82
- Watchers
- 2
- Open issues
- 0
- Releases
- 0
- Created
- 2026-08-07
- Stars this week
- +3
You've seen where tools stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.