tools

Tools, ComfyUI workflows and benchmark configs from a 4x RTX 3090 local-inference rig

alesha-pro/tools

View on GitHub ↗

Tools, ComfyUI workflows and benchmark configs from a 4x RTX 3090 local-inference rig

tools grew +2.2% in the last 30 days, ranks 195th of 539 in Local Runtime / Inference Engine, last commit 54 days ago.

Star trajectory

64 days tracked
2026-09-18702 stars today2026-11-22
Momentum

+2.2% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 54 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

tools
702
stars
+2.2% 30d
commit 54 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 195th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

    -1 (-0.4%) in 30d · Committed 705d ago · Python · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

  2. Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    +442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

  3. A high-performance inference engine for AI models

    +837 (+33%) in 30d · Committed today · Rust · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  4. Lucebox inference engine for heterogeneous hardware & consumer GPUs

    +76 (+2.6%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  5. Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127…

    +592 (+27%) in 30d · Committed 12d ago · Python · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

  6. Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

    +97 (+4.9%) in 30d · Committed today · C++ · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  7. Community maintained hardware plugin for vLLM on Apple Silicon

    +109 (+5.7%) in 30d · Committed today · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  8. A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is…

    +23 (+1.4%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  9. Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models…

    +341 (+32%) in 30d · Committed 3d ago · Shell · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  10. Zero-GPU CPU inference for 30B-284B MoE models (Qwen3.8 176.5B cold-cache certified in 28.26/48.35 GiB Cgroup…

    Committed today · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

Language
HTML
License
MIT License
Contributors
4
Forks
82
Watchers
2
Open issues
0
Releases
0
Created
2026-08-07
Stars this week
+3

You've seen where tools stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain tools?

Claim this page to add your own call-to-action.

Claim this page