llama.cpp

LLM inference in C/C++

ggml-org/llama.cpp

View on GitHub ↗

LLM inference in C/C++

llama.cpp grew +3.0% in the last 30 days, ranks 3rd of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.

Star trajectory

150 days tracked
2026-06-24136k stars today2026-11-22
Momentum

+3.0% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit today, fresher than the median of 6d.

How it compares in Local Runtime / Inference Engine

llama.cpp
136k
stars
+3.0% 30d
commit today
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 3rd of 539 by stars.

Ranked by shared tags, then keywords, then stars

Where llama.cpp sits

Hover or focus a node for details. Click to open it.

  • This repo
  • Related repo
  • Tag or category
  1. Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

    +3.5k (+1.9%) in 30d · Committed today · Go · MIT

    Shares Local Runtime / Inference Engine

  2. The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest…

    +5.9k (+4.2%) in 30d · Committed today · Python · GPL-3.0

    Shares Local Runtime / Inference Engine

  3. LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No…

    +633 (+1.3%) in 30d · Committed today · Go · MIT

    Shares Local Runtime / Inference Engine

  4. AirLLM 2.8T LLM inference with single 4GB GPU

    +2.5k (+6.2%) in 30d · Committed today · Jupyter Notebook · Apache-2.0

    Shares Local Runtime / Inference Engine

  5. VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life…

    +2.9k (+7.3%) in 30d · Committed 13d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine

  6. Hundreds of models & providers. One command to find what runs on your hardware.

    +949 (+2.5%) in 30d · Committed 3d ago · Rust · MIT

    Shares Local Runtime / Inference Engine

  7. TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google…

    +932 (+2.7%) in 30d · Committed 9d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine

  8. Find secrets with Gitleaks 🔑

    +1k (+3.3%) in 30d · Committed 25d ago · Go · MIT

    Shares Local Runtime / Inference Engine

  9. 🚀 AI 全自动短视频引擎 | AI Fully Automated Short Video Engine

    +1.1k (+3.7%) in 30d · Committed 160d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine

  10. Distribute and run LLMs with a single file.

    +228 (+0.9%) in 30d · Committed 13d ago · C++ · Other license

    Shares Local Runtime / Inference Engine

Language
C++
License
MIT License
Contributors
2,289
Forks
25.9k
Watchers
908
Open issues
698
Releases
1,000
Created
2023-03-10
Stars this week
+866

You've seen where llama.cpp stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain llama.cpp?

Claim this page to add your own call-to-action.

Claim this page