llama.cpp
LLM inference in C/C++
ggml-org/llama.cpp
View on GitHub ↗LLM inference in C/C++
llama.cpp grew +3.0% in the last 30 days, ranks 3rd of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.
Star trajectory
150 days tracked+3.0% in 30d, above the Local Runtime / Inference Engine median of +1.9%.
Last commit today, fresher than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 3rd of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere llama.cpp sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
- ollama/ollama187.8k
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
+3.5k (+1.9%) in 30d · Committed today · Go · MIT
Shares Local Runtime / Inference Engine
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest…
+5.9k (+4.2%) in 30d · Committed today · Python · GPL-3.0
Shares Local Runtime / Inference Engine
- mudler/LocalAI50.5k
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No…
+633 (+1.3%) in 30d · Committed today · Go · MIT
Shares Local Runtime / Inference Engine
- lyogavin/airllm42.9k
AirLLM 2.8T LLM inference with single 4GB GPU
+2.5k (+6.2%) in 30d · Committed today · Jupyter Notebook · Apache-2.0
Shares Local Runtime / Inference Engine
- OpenBMB/VoxCPM42.9k
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life…
+2.9k (+7.3%) in 30d · Committed 13d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine
- AlexsJones/llmfit39.2k
Hundreds of models & providers. One command to find what runs on your hardware.
+949 (+2.5%) in 30d · Committed 3d ago · Rust · MIT
Shares Local Runtime / Inference Engine
TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google…
+932 (+2.7%) in 30d · Committed 9d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine
- gitleaks/gitleaks31.2k
Find secrets with Gitleaks 🔑
+1k (+3.3%) in 30d · Committed 25d ago · Go · MIT
Shares Local Runtime / Inference Engine
🚀 AI 全自动短视频引擎 | AI Fully Automated Short Video Engine
+1.1k (+3.7%) in 30d · Committed 160d ago · Python · Apache-2.0
Shares Local Runtime / Inference Engine
- mozilla-ai/llamafile26.7k
Distribute and run LLMs with a single file.
+228 (+0.9%) in 30d · Committed 13d ago · C++ · Other license
Shares Local Runtime / Inference Engine
- Language
- C++
- License
- MIT License
- Contributors
- 2,289
- Forks
- 25.9k
- Watchers
- 908
- Open issues
- 698
- Releases
- 1,000
- Created
- 2023-03-10
- Stars this week
- +866
You've seen where llama.cpp stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.