ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
intel/ipex-llm
View on GitHub ↗Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
ipex-llm grew -0.1% in the last 30 days, ranks 31st of 509 in Local Runtime / Inference Engine, last commit 285 days ago.
Star trajectory
131 days tracked-0.1% in 30d, below the Local Runtime / Inference Engine median of +1.9%.
Last commit 285 days ago, staler than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 31st of 509 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere ipex-llm sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by…
+0 (+0.0%) in 30d · Committed 512d ago · Python · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Fine-Tuning (LoRA / PEFT)
Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI…
+5 (+7.1%) in 30d · Committed 29d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Fine-Tuning (LoRA / PEFT)
The Fastest Way to Fine-Tune LLMs Locally
-1 (-0.3%) in 30d · Committed 326d ago · Python · Apache-2.0
Shares Fine-Tuning (LoRA / PEFT), Local Runtime / Inference Engine
PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving…
+5 (+1.5%) in 30d · Committed 7d ago · Rust · Other license
Shares Local Runtime / Inference Engine, Inference Optimization
Jebadiah, an open System One decision model: trainer, data builders, evals and every run record
+4 (+80%) in 30d · Committed 19d ago · Python · Apache-2.0
Shares Fine-Tuning (LoRA / PEFT), Local Runtime / Inference Engine
A Mac-local specialist-model factory for data, post-training, evaluation, packaging, and evidence-backed…
+0 (+0.0%) in 30d · Committed today · Swift · MIT
Shares Fine-Tuning (LoRA / PEFT), Local Runtime / Inference Engine
Fine-tune an 8B LLM on a 4 GB laptop GPU, check it with real quality gates, and serve it (pip install…
Committed 5d ago · Python · Apache-2.0
Shares Fine-Tuning (LoRA / PEFT), Local Runtime / Inference Engine
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS…
+2.5k (+28%) in 30d · Committed 39d ago · C · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX…
+204 (+2.5%) in 30d · Committed today · Python · MIT
Shares Local Runtime / Inference Engine, Inference Optimization
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
+450 (+6.5%) in 30d · Committed 14d ago · Swift · Apache-2.0
Shares Inference Optimization, Local Runtime / Inference Engine
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 125
- Forks
- 1.4k
- Watchers
- 8
- Open issues
- 1.2k
- Releases
- 22
- Created
- 2016-08-29
- Stars this week
- -4
You've seen where ipex-llm stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.