intel-arc-pro-b70-inference-cookbook

Pinned Intel Arc Pro B60/B70 inference recipes, engine patches and measurement records: Qwen3.8-27B EXL3 on one card (262,144 context, 63 tok/s; MTP3 measured lossy on 27% of a fixed 329-item set), Nemotron Bolt 74B, Flash-Next, dual-card routes, and a machine-checked catalog where each speculative row states whether the drafter changes the answer.

SergiioB/intel-arc-pro-b70-inference-cookbook

View on GitHub ↗

Pinned Intel Arc Pro B60/B70 inference recipes, engine patches and measurement records: Qwen3.8-27B EXL3 on one card (262,144 context, 63 tok/s; MTP3 measured lossy on 27% of a fixed 329-item set), Nemotron Bolt 74B, Flash-Next, dual-card routes, and a machine-checked catalog where each speculative row states whether the drafter changes the answer.

intel-arc-pro-b70-inference-cookbook grew +10.9% in the last 30 days, ranks 357th of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.

Star trajectory

82 days tracked
2026-08-31204 stars today2026-11-22
Momentum

+10.9% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit today, fresher than the median of 6d.

How it compares in Local Runtime / Inference Engine

intel-arc-pro-b70-inference-cookbook
204
stars
+10.9% 30d
commit today
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 357th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. RDNA-native LLM inference engine in Rust.

    +95 (+13%) in 30d · Committed today · Rust · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  2. Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K…

    +22 (+18%) in 30d · Committed 37d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  3. Memra is a Rust + CUDA LLM inference engine with hand-written kernels, NVFP4 and mixed-precision execution…

    +4 (+100%) in 30d · Committed today · Rust · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  4. Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127…

    +592 (+27%) in 30d · Committed 12d ago · Python · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine, Model Optimization

  5. Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    +25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine, Model Optimization

  6. Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…

    +8 (+1.5%) in 30d · Committed 10d ago · C++ · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  7. Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…

    +36 (+15%) in 30d · Committed 2d ago · Python · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  8. Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one…

    +31 (+18%) in 30d · Committed today · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  9. SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86…

    +0 (+0.0%) in 30d · Committed 52d ago · Python · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine, Model Optimization

  10. LLM Inference on consumer devices

    +0 (+0.0%) in 30d · Committed 614d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

Language
Python
License
MIT License
Contributors
6
Forks
13
Watchers
13
Open issues
2
Releases
27
Created
2026-08-06
Stars this week
+7

You've seen where intel-arc-pro-b70-inference-cookbook stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain intel-arc-pro-b70-inference-cookbook?

Claim this page to add your own call-to-action.

Claim this page