self-hosted-ai-stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.

hwdsl2/self-hosted-ai-stack

View on GitHub ↗

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.

self-hosted-ai-stack grew +7.6% in the last 30 days, ranks 363rd of 494 in Local Runtime / Inference Engine, actively maintained, last commit yesterday.

Star trajectory

79 days tracked
2026-08-07170 stars today2026-10-25
Momentum

+7.6% in 30d, above the Local Runtime / Inference Engine median of +1.7%.

Maintenance

Last commit yesterday, fresher than the median of 5d.

How it compares in Local Runtime / Inference Engine

self-hosted-ai-stack
170
stars
+7.6% 30d
commit yesterday
Local Runtime / Inference Engine median
414
stars
+1.7% 30d
commit ~5d ago
Leader · ollama
184.7k
stars
+1.7% 30d
commit today

Ranked 363rd of 494 by stars.

Language
Shell
License
MIT License
Contributors
1
Forks
34
Watchers
4
Open issues
0
Releases
3
Created
2026-05-05
Stars this week
+3

You've seen where self-hosted-ai-stack stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain self-hosted-ai-stack?

Claim this page to add your own call-to-action.

Claim this page