hal0
Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.
Hal0ai/hal0
View on GitHub ↗Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.
hal0 grew +4.8% in the last 30 days, ranks 486th of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.
Star trajectory
82 days tracked+4.8% in 30d, above the Local Runtime / Inference Engine median of +1.9%.
Last commit today, fresher than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 486th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere hal0 sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings…
+11 (+6.5%) in 30d · Committed 4d ago · Shell · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment, LLM Gateway & Routing
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features…
+11 (+7.1%) in 30d · Committed 196d ago · Python · MIT
Shares LLM Gateway & Routing, Local Runtime / Inference Engine, Production Serving & Deployment
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
+2 (+1.3%) in 30d · Committed 4d ago · Go · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment, LLM Gateway & Routing
Local AI routing gateway with Agent client takeover — reuse existing client logins, call 50+ AI clients…
+1.3k (+102%) in 30d · Committed today · Rust · AGPL-3.0
Shares LLM Gateway & Routing, Local Runtime / Inference Engine, Production Serving & Deployment
Self-hosted AI API gateway: OpenAI-compatible reverse proxies + aggregation gateway + tooling on your own VPS
-1 (-1.0%) in 30d · Committed 166d ago · Python · MIT
Shares LLM Gateway & Routing, Production Serving & Deployment, Local Runtime / Inference Engine
Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI…
+3 (+4.1%) in 30d · Committed 41d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Production Serving & Deployment
'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and…
+6 (+1.7%) in 30d · Committed 21d ago · Swift · MIT
Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Production Serving & Deployment
Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…
+36 (+15%) in 30d · Committed 2d ago · Python · MIT
Shares Production Serving & Deployment, Local Runtime / Inference Engine, LLM Gateway & Routing
A local app that rents a GPU in your own Colab account and serves Qwen3.8 on it: 27B on an A100-40G, or…
+6 (+6.1%) in 30d · Committed 42d ago · Python · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment, LLM Gateway & Routing
Fast & opinionated local AI routing: one MCP server that loads local image and video models on demand on your…
Committed yesterday · Zig · Apache-2.0
Shares Local Runtime / Inference Engine, Production Serving & Deployment, LLM Gateway & Routing
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 13
- Forks
- 13
- Watchers
- 2
- Open issues
- 211
- Releases
- 70
- Created
- 2026-05-15
- Stars this week
- +1
You've seen where hal0 stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.