ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

intel/ipex-llm

View on GitHub ↗

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

ipex-llm grew -0.1% in the last 30 days, ranks 31st of 509 in Local Runtime / Inference Engine, last commit 285 days ago.

Star trajectory

131 days tracked
2026-07-028.8k stars today2026-11-10
Momentum

-0.1% in 30d, below the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 285 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

ipex-llm
8.8k
stars
-0.1% 30d
commit 285 days ago
Local Runtime / Inference Engine median
376
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
186.5k
stars
+2.1% 30d
commit today

Ranked 31st of 509 by stars.

Ranked by shared tags, then keywords, then stars
  1. SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by…

    +0 (+0.0%) in 30d · Committed 512d ago · Python · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Fine-Tuning (LoRA / PEFT)

  2. Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI…

    +5 (+7.1%) in 30d · Committed 29d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Fine-Tuning (LoRA / PEFT)

  3. The Fastest Way to Fine-Tune LLMs Locally

    -1 (-0.3%) in 30d · Committed 326d ago · Python · Apache-2.0

    Shares Fine-Tuning (LoRA / PEFT), Local Runtime / Inference Engine

  4. PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving…

    +5 (+1.5%) in 30d · Committed 7d ago · Rust · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  5. Jebadiah, an open System One decision model: trainer, data builders, evals and every run record

    +4 (+80%) in 30d · Committed 19d ago · Python · Apache-2.0

    Shares Fine-Tuning (LoRA / PEFT), Local Runtime / Inference Engine

  6. A Mac-local specialist-model factory for data, post-training, evaluation, packaging, and evidence-backed…

    +0 (+0.0%) in 30d · Committed today · Swift · MIT

    Shares Fine-Tuning (LoRA / PEFT), Local Runtime / Inference Engine

  7. Fine-tune an 8B LLM on a 4 GB laptop GPU, check it with real quality gates, and serve it (pip install…

    Committed 5d ago · Python · Apache-2.0

    Shares Fine-Tuning (LoRA / PEFT), Local Runtime / Inference Engine

  8. A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS…

    +2.5k (+28%) in 30d · Committed 39d ago · C · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  9. A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX…

    +204 (+2.5%) in 30d · Committed today · Python · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  10. Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    +450 (+6.5%) in 30d · Committed 14d ago · Swift · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

Language
Python
License
Apache License 2.0
Contributors
125
Forks
1.4k
Watchers
8
Open issues
1.2k
Releases
22
Created
2016-08-29
Stars this week
-4

You've seen where ipex-llm stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain ipex-llm?

Claim this page to add your own call-to-action.

Claim this page