Promethevs

PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-then-correct), OpenAI-compatible local server, report and logs.

Magnvs7/Promethevs

View on GitHub ↗

PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-then-correct), OpenAI-compatible local server, report and logs.

Promethevs ranks 372nd of 539 in Local Runtime / Inference Engine, actively maintained, last commit 12 days ago.

Star trajectory

16 days tracked
2026-11-06193 stars today2026-11-22
Momentum

- in 30d, below the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 12 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

Promethevs
193
stars
- 30d
commit 12 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 372nd of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment

  2. Run large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090…

    Committed today · C++ · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization

  3. The best model under 200B at near 10 token/s exact batch throughput on a single laptop CPU, with an automatic…

    +1 (+4.3%) in 30d · Committed 73d ago · C · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment

  4. Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B) and Hy4-Flash…

    +1.6k (+108%) in 30d · Committed today · Cuda · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization

  5. Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment

  6. Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    +25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Production Serving & Deployment, Inference Optimization, Local Runtime / Inference Engine

  7. Xolotl: run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM)…

    +264 (+90%) in 30d · Committed today · C++ · MIT

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization

  8. Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…

    +36 (+15%) in 30d · Committed 2d ago · Python · MIT

    Shares Production Serving & Deployment, Local Runtime / Inference Engine, Inference Optimization

  9. run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and…

    +31 (+19%) in 30d · Committed 35d ago · Python

    Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization

  10. An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports…

    +45 (+41%) in 30d · Committed today · C++ · AGPL-3.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment

Language
-
License
Creative Commons Attribution 4.0 International
Contributors
2
Forks
13
Watchers
3
Open issues
10
Releases
1
Created
2026-10-21
Stars this week
+6

You've seen where Promethevs stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain Promethevs?

Claim this page to add your own call-to-action.

Claim this page