ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
intel/ipex-llm
View on GitHub ↗Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
ipex-llm grew -0.1% in the last 30 days, ranks 32nd of 490 in Local Runtime / Inference Engine, last commit 267 days ago.
Star trajectory
113 days tracked-0.1% in 30d, below the Local Runtime / Inference Engine median of +1.7%.
Last commit 267 days ago, staler than the median of 5.5d.
How it compares in Local Runtime / Inference Engine
Ranked 32nd of 490 by stars.
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 125
- Forks
- 1.4k
- Watchers
- 12
- Open issues
- 1.2k
- Releases
- 22
- Created
- 2016-08-29
- Stars this week
- -2
You've seen where ipex-llm stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.