strixite

LLM inference engine written from scratch in HIP for AMD Strix Halo (gfx1151) and Qwen3.8-Flash-Next - ~50 tokens/s out to 492k context

shawnshekari/strixite

View on GitHub ↗

LLM inference engine written from scratch in HIP for AMD Strix Halo (gfx1151) and Qwen3.8-Flash-Next - ~50 tokens/s out to 492k context

strixite ranks 462nd of 539 in Local Runtime / Inference Engine, actively maintained, last commit 5 days ago.

Star trajectory

25 days tracked
2026-10-28108 stars today2026-11-22
Momentum

- in 30d, below the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 5 days ago, fresher than the median of 6d.

How it compares in Local Runtime / Inference Engine

strixite
108
stars
- 30d
commit 5 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 462nd of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.

    +43 (+14%) in 30d · Committed 31d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, GPU Kernels

  2. Rust + CUDA inference engine for NVIDIA RTX PRO 6000 Blackwell and RTX 5090. Serves safetensors and GGUF over…

    +37 (+13%) in 30d · Committed today · OpenEdge ABL · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, GPU Kernels

  3. OrbitKV is a High Performance KV Cache System for LLM Inference.

    -52 (-15%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Inference Optimization, GPU Kernels, Local Runtime / Inference Engine

  4. :metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

    -1.6k (-92%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, GPU Kernels

  5. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  6. 37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs…

    +280 (+61%) in 30d · Committed yesterday · C · GPL-3.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  7. Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…

    +36 (+15%) in 30d · Committed 2d ago · Python · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  8. run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and…

    +31 (+19%) in 30d · Committed 35d ago · Python

    Shares Local Runtime / Inference Engine, Inference Optimization

  9. Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    +442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

  10. Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127…

    +592 (+27%) in 30d · Committed 12d ago · Python · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

Language
C++
License
GNU Affero General Public License v3.0
Contributors
3
Forks
14
Watchers
4
Open issues
4
Releases
12
Created
2026-10-04
Stars this week
+5

You've seen where strixite stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain strixite?

Claim this page to add your own call-to-action.

Claim this page