halogen-server

The fastest way to run Qwen3.8 27B on Strix Halo (gfx1151)

peonist-ai/halogen-server

View on GitHub ↗

The fastest way to run Qwen3.8 27B on Strix Halo (gfx1151)

halogen-server grew +22.1% in the last 30 days, ranks 394th of 539 in Local Runtime / Inference Engine, last commit 68 days ago.

Star trajectory

66 days tracked
2026-09-16166 stars today2026-11-22
Momentum

+22.1% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 68 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

halogen-server
166
stars
+22.1% 30d
commit 68 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 394th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  2. Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…

    +36 (+15%) in 30d · Committed 2d ago · Python · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  3. run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and…

    +31 (+19%) in 30d · Committed 35d ago · Python

    Shares Local Runtime / Inference Engine, Inference Optimization

  4. An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports…

    +45 (+41%) in 30d · Committed today · C++ · AGPL-3.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  5. The fastest way to run Inkling 2 Mini, Qwen 3.8 and Ternary Bonsai 2 27B on a Mac: Inkling 2 Mini at up to…

    +107 (+4.1%) in 30d · Committed today · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  6. Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models…

    +341 (+32%) in 30d · Committed 3d ago · Shell · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  7. Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.

    +15 (+1.8%) in 30d · Committed 49d ago · Rust · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  8. Xolotl: run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM)…

    +264 (+90%) in 30d · Committed today · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  9. Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over…

    +10 (+1.8%) in 30d · Committed yesterday · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  10. llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

    +2 (+0.7%) in 30d · Committed 2d ago · Go · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

Language
Python
License
Other
Contributors
1
Forks
9
Watchers
4
Open issues
6
Releases
0
Created
2026-08-26
Stars this week
+6

You've seen where halogen-server stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain halogen-server?

Claim this page to add your own call-to-action.

Claim this page