toskar-core

Run AI models like Llama, Qwen, and Gemma on every computer you own, and manage them for everyone on your network. Local first, with OpenAI- and Anthropic-compatible APIs, people and roles, and MCP.

yeixio/toskar-core

View on GitHub ↗

Run AI models like Llama, Qwen, and Gemma on every computer you own, and manage them for everyone on your network. Local first, with OpenAI- and Anthropic-compatible APIs, people and roles, and MCP.

toskar-core ranks 98th of 99 in Distributed Inference, actively maintained, last commit today.

Star trajectory

22 days tracked
2026-10-315 stars today2026-11-22
Momentum

- in 30d, below the Distributed Inference median of +1.2%.

Maintenance

Last commit today, fresher than the median of 5d.

How it compares in Distributed Inference

toskar-core
5
stars
- 30d
commit today
Distributed Inference median
299
stars
+1.2% 30d
commit ~5d ago
Leader · exo
48.5k
stars
+1.1% 30d
commit 15 days ago

Ranked 98th of 99 by stars.

Ranked by shared tags, then keywords, then stars
  1. Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings…

    +11 (+6.5%) in 30d · Committed 4d ago · Shell · MIT

    Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Agent Frontends / Chat UI

  2. The local model runtime that makes llama.cpp behave like an API provider.

    Committed today · Rust · AGPL-3.0

    Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Agent Frontends / Chat UI

  3. Fine-tune and run LLMs locally on your M-series Mac. A powerful desktop interface built on Apple's MLX…

    Committed 315d ago · TypeScript · MIT

    Shares Local Runtime / Inference Engine, Fine-Tuning (LoRA / PEFT), Agent Frontends / Chat UI

  4. Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI…

    +3 (+4.1%) in 30d · Committed 41d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Fine-Tuning (LoRA / PEFT)

  5. Your private, on-device personal AI assistant for macOS, Windows and Linux. Chat, create, search files, and…

    +24 (+18%) in 30d · Committed today · TypeScript · AGPL-3.0

    Shares Agent Frontends / Chat UI, Local Runtime / Inference Engine, LLM Gateway & Routing

  6. A Mac-local specialist-model factory for data, post-training, evaluation, packaging, and evidence-backed…

    +0 (+0.0%) in 30d · Committed yesterday · Swift · MIT

    Shares Fine-Tuning (LoRA / PEFT), Local Runtime / Inference Engine

  7. Paxeer X is a Distributed HyperState Machine for payments, code execution and intent routing. Designed for…

    -135 (-24%) in 30d · Committed today · TypeScript · Other license

    Shares Distributed Inference, LLM Gateway & Routing

  8. Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every…

    +18 (+16%) in 30d · Committed 16d ago · Python · MIT

    Shares Local Runtime / Inference Engine, Agent Frontends / Chat UI

  9. Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude…

    +9.5k (+12%) in 30d · Committed today · TypeScript · MIT

    Shares LLM Gateway & Routing, Agent Frontends / Chat UI

  10. ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux…

    +235 (+3.1%) in 30d · Committed 2d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Agent Frontends / Chat UI

Language
Go
License
GNU Affero General Public License v3.0
Contributors
9
Forks
6
Watchers
0
Open issues
111
Releases
37
Created
2026-09-25
Stars this week
+0

You've seen where toskar-core stands today.

Get the moves before everyone else: the 5 Distributed Inference repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain toskar-core?

Claim this page to add your own call-to-action.

Claim this page