toskar-core
Run AI models like Llama, Qwen, and Gemma on every computer you own, and manage them for everyone on your network. Local first, with OpenAI- and Anthropic-compatible APIs, people and roles, and MCP.
yeixio/toskar-core
View on GitHub ↗Run AI models like Llama, Qwen, and Gemma on every computer you own, and manage them for everyone on your network. Local first, with OpenAI- and Anthropic-compatible APIs, people and roles, and MCP.
toskar-core ranks 98th of 99 in Distributed Inference, actively maintained, last commit today.
Star trajectory
22 days tracked- in 30d, below the Distributed Inference median of +1.2%.
Last commit today, fresher than the median of 5d.
How it compares in Distributed Inference
Ranked 98th of 99 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere toskar-core sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings…
+11 (+6.5%) in 30d · Committed 4d ago · Shell · MIT
Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Agent Frontends / Chat UI
The local model runtime that makes llama.cpp behave like an API provider.
Committed today · Rust · AGPL-3.0
Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Agent Frontends / Chat UI
Fine-tune and run LLMs locally on your M-series Mac. A powerful desktop interface built on Apple's MLX…
Committed 315d ago · TypeScript · MIT
Shares Local Runtime / Inference Engine, Fine-Tuning (LoRA / PEFT), Agent Frontends / Chat UI
Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI…
+3 (+4.1%) in 30d · Committed 41d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Fine-Tuning (LoRA / PEFT)
Your private, on-device personal AI assistant for macOS, Windows and Linux. Chat, create, search files, and…
+24 (+18%) in 30d · Committed today · TypeScript · AGPL-3.0
Shares Agent Frontends / Chat UI, Local Runtime / Inference Engine, LLM Gateway & Routing
A Mac-local specialist-model factory for data, post-training, evaluation, packaging, and evidence-backed…
+0 (+0.0%) in 30d · Committed yesterday · Swift · MIT
Shares Fine-Tuning (LoRA / PEFT), Local Runtime / Inference Engine
Paxeer X is a Distributed HyperState Machine for payments, code execution and intent routing. Designed for…
-135 (-24%) in 30d · Committed today · TypeScript · Other license
Shares Distributed Inference, LLM Gateway & Routing
Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every…
+18 (+16%) in 30d · Committed 16d ago · Python · MIT
Shares Local Runtime / Inference Engine, Agent Frontends / Chat UI
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude…
+9.5k (+12%) in 30d · Committed today · TypeScript · MIT
Shares LLM Gateway & Routing, Agent Frontends / Chat UI
- Osmantic/ODS7.9k
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux…
+235 (+3.1%) in 30d · Committed 2d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Agent Frontends / Chat UI
- Language
- Go
- License
- GNU Affero General Public License v3.0
- Contributors
- 9
- Forks
- 6
- Watchers
- 0
- Open issues
- 111
- Releases
- 37
- Created
- 2026-09-25
- Stars this week
- +0
You've seen where toskar-core stands today.
Get the moves before everyone else: the 5 Distributed Inference repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.