collabosm

A local app that rents a GPU in your own Colab account and serves Qwen3.8 on it: 27B on an A100-40G, or Flash-Next (125B-A6B MoE) on an A100-80G. The cost is shown before it starts; chat with images; Codex or any OpenAI client uses a fixed local /v1. Auto-stop, CU ledger, live prefill/decode. Windows, macOS, Linux.

architectds/collabosm

View on GitHub ↗

A local app that rents a GPU in your own Colab account and serves Qwen3.8 on it: 27B on an A100-40G, or Flash-Next (125B-A6B MoE) on an A100-80G. The cost is shown before it starts; chat with images; Codex or any OpenAI client uses a fixed local /v1. Auto-stop, CU ledger, live prefill/decode. Windows, macOS, Linux.

collabosm grew +6.1% in the last 30 days, ranks 467th of 539 in Local Runtime / Inference Engine, last commit 42 days ago.

Star trajectory

54 days tracked
2026-09-28105 stars today2026-11-22
Momentum

+6.1% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 42 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

collabosm
105
stars
+6.1% 30d
commit 42 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 467th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…

    +36 (+15%) in 30d · Committed 2d ago · Python · MIT

    Shares Production Serving & Deployment, Local Runtime / Inference Engine, LLM Gateway & Routing

  2. SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features…

    +11 (+7.1%) in 30d · Committed 196d ago · Python · MIT

    Shares LLM Gateway & Routing, Local Runtime / Inference Engine, Production Serving & Deployment

  3. Fast & opinionated local AI routing: one MCP server that loads local image and video models on demand on your…

    Committed yesterday · Zig · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, LLM Gateway & Routing

  4. The fastest inference engine for Qwen3.8-27B on the NVIDIA RTX 5090: up to 500 tokens/s for one agent and up…

    Committed 17d ago · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, LLM Gateway & Routing

  5. Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI…

    +3 (+4.1%) in 30d · Committed 41d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Production Serving & Deployment

  6. Local AI routing gateway with Agent client takeover — reuse existing client logins, call 50+ AI clients…

    +1.3k (+102%) in 30d · Committed today · Rust · AGPL-3.0

    Shares LLM Gateway & Routing, Local Runtime / Inference Engine, Production Serving & Deployment

  7. Run many AI agents at once on your Mac, up to 3x faster.

    +273 (+91%) in 30d · Committed today · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, LLM Gateway & Routing

  8. 'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and…

    +6 (+1.7%) in 30d · Committed 21d ago · Swift · MIT

    Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Production Serving & Deployment

  9. Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings…

    +11 (+6.5%) in 30d · Committed 4d ago · Shell · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, LLM Gateway & Routing

  10. Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

    +2 (+1.3%) in 30d · Committed 4d ago · Go · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, LLM Gateway & Routing

Language
Python
License
MIT License
Contributors
1
Forks
6
Watchers
1
Open issues
0
Releases
0
Created
2026-09-25
Stars this week
+1

You've seen where collabosm stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain collabosm?

Claim this page to add your own call-to-action.

Claim this page