go-llama

llama.cpp in pure Go

goccy/go-llama

View on GitHub ↗

llama.cpp in pure Go

go-llama grew +4.1% in the last 30 days, ranks 379th of 539 in Local Runtime / Inference Engine, last commit 31 days ago.

Star trajectory

82 days tracked
2026-08-31177 stars today2026-11-22
Momentum

+4.1% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 31 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

go-llama
177
stars
+4.1% 30d
commit 31 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 379th of 539 by stars.

Ranked by shared tags, then keywords, then stars

Where go-llama sits

Hover or focus a node for details. Click to open it.

  • This repo
  • Related repo
  • Tag or category
  1. Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp…

    +22 (+2.6%) in 30d · Committed today · Go · Apache-2.0

    Shares Local Runtime / Inference Engine, Language Bindings

  2. 2bit quants, kernels and runtime for consumer devices.

    Committed 16d ago · C++ · Other license

    Shares Local Runtime / Inference Engine, Language Bindings

  3. Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model…

    +16 (+0.7%) in 30d · Committed today · TypeScript · MIT

    Shares Local Runtime / Inference Engine, Language Bindings

  4. Community maintained hardware plugin for vLLM on Apple Silicon

    +109 (+5.7%) in 30d · Committed today · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Language Bindings

  5. NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

    +83 (+5.1%) in 30d · Committed 2d ago · Rust · EUPL-1.2

    Shares Local Runtime / Inference Engine, Language Bindings

  6. Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on…

    +2 (+0.2%) in 30d · Committed 1,207d ago · Rust · Apache-2.0

    Shares Local Runtime / Inference Engine, Language Bindings

  7. Simple, modular, and observable Go framework for backend applications.

    -1 (-0.1%) in 30d · Committed 31d ago · Go · MIT

    Shares Local Runtime / Inference Engine, Language Bindings

  8. a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…

    +34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Language Bindings

  9. Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to…

    +167 (+53%) in 30d · Committed today · Rust · Apache-2.0

    Shares Local Runtime / Inference Engine, Language Bindings

  10. Suite of tools containing an in-memory vector datastore and AI proxy

    +0 (+0.0%) in 30d · Committed 8d ago · Rust · MIT

    Shares Local Runtime / Inference Engine, Language Bindings

Language
Go
License
MIT License
Contributors
1
Forks
5
Watchers
1
Open issues
0
Releases
14
Created
2026-08-01
Stars this week
+1

You've seen where go-llama stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain go-llama?

Claim this page to add your own call-to-action.

Claim this page