node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
withcatai/node-llama-cpp
View on GitHub ↗Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
node-llama-cpp grew +0.4% in the last 30 days, ranks 81st of 496 in Local Runtime / Inference Engine, actively maintained, last commit 5 days ago.
Star trajectory
80 days tracked2026-08-072.2k stars today2026-10-26
Momentum
+0.4% in 30d, below the Local Runtime / Inference Engine median of +1.7%.
Maintenance
Last commit 5 days ago, fresher than the median of 6d.
How it compares in Local Runtime / Inference Engine
node-llama-cpp
2.2k
stars
+0.4% 30d
commit 5 days ago
Local Runtime / Inference Engine median
409.5
stars
+1.7% 30d
commit ~6d ago
Leader · ollama
184.8k
stars
+1.7% 30d
commit today
Ranked 81st of 496 by stars.
syv-ai/HyperQwen2.2k-38floneum/kalosm2.2k-34
withcatai/node-llama-cpp2.2k
neuron-core/neuron-ai2.2k+40travisvn/openai-edge-tts2.1k+60- Language
- TypeScript
- License
- MIT License
- Contributors
- 18
- Forks
- 224
- Watchers
- 22
- Open issues
- 32
- Releases
- 142
- Created
- 2023-08-12
- Stars this week
- +2
You've seen where node-llama-cpp stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.