qwen3.8-27b-in-c

Qwen3.8-27B on one laptop CPU: up to 2.52 token/s, 8 GB tested, no runtime accuracy loss. Native OpenAI-compatible API with function tools; no GPU or Python. | 单颗笔记本 CPU 运行 Qwen3.8-27B:最快 2.52 token/s,最低 8 GB 内存可运行,推理加速不牺牲准确性。原生 OpenAI 兼容接口支持函数工具;无需 GPU 或 Python。

shyringo/qwen3.8-27b-in-c

View on GitHub ↗

Qwen3.8-27B on one laptop CPU: up to 2.52 token/s, 8 GB tested, no runtime accuracy loss. Native OpenAI-compatible API with function tools; no GPU or Python. | 单颗笔记本 CPU 运行 Qwen3.8-27B:最快 2.52 token/s,最低 8 GB 内存可运行,推理加速不牺牲准确性。原生 OpenAI 兼容接口支持函数工具;无需 GPU 或 Python。

qwen3.8-27b-in-c grew +14.3% in the last 30 days, ranks 524th of 539 in Local Runtime / Inference Engine, last commit 73 days ago.

Star trajectory

82 days tracked
2026-08-3124 stars today2026-11-22
Momentum

+14.3% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 73 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

qwen3.8-27b-in-c
24
stars
+14.3% 30d
commit 73 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 524th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. The best model under 200B at near 10 token/s exact batch throughput on a single laptop CPU, with an automatic…

    +1 (+4.3%) in 30d · Committed 73d ago · C · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  2. A Rust-native LLM serving engine. One binary, no Python runtime.

    +1 (+4.8%) in 30d · Committed today · Rust · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  3. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  4. vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm

    +25 (+2.8%) in 30d · Committed yesterday · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  5. Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    +25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

  6. Xolotl: run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM)…

    +264 (+90%) in 30d · Committed today · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  7. Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over…

    +10 (+1.8%) in 30d · Committed yesterday · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  8. Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…

    +36 (+15%) in 30d · Committed 2d ago · Python · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  9. One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no…

    -1 (-0.4%) in 30d · Committed 191d ago · Python

    Shares Local Runtime / Inference Engine, Inference Optimization

  10. Kindi 0.6.1: fast local LLM inference on low-cost GPUs and CPUs. DeepSeek-V4.1-Flash (552B) at 18.7 tok/s on…

    Committed 5d ago · Python · AGPL-3.0

    Shares Local Runtime / Inference Engine, Inference Optimization

Language
C
License
Apache License 2.0
Contributors
1
Forks
6
Watchers
2
Open issues
0
Releases
4
Created
2026-08-24
Stars this week
+0

You've seen where qwen3.8-27b-in-c stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain qwen3.8-27b-in-c?

Claim this page to add your own call-to-action.

Claim this page