AbliteratedOutTheBox

llama.cpp fork that abliterates at inference

heterodoxin/AbliteratedOutTheBox

View on GitHub ↗

llama.cpp fork that abliterates at inference

AbliteratedOutTheBox ranks 349th of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.

Star trajectory

27 days tracked
2026-10-26220 stars today2026-11-22
Momentum

- in 30d, below the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit today, fresher than the median of 6d.

How it compares in Local Runtime / Inference Engine

AbliteratedOutTheBox
220
stars
- 30d
commit today
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 349th of 539 by stars.

Ranked by shared tags, then keywords, then stars

Where AbliteratedOutTheBox sits

Hover or focus a node for details. Click to open it.

  • This repo
  • Related repo
  • Tag or category
  1. A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS…

    +3.4k (+37%) in 30d · Committed 5d ago · C · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  2. Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

    +97 (+4.9%) in 30d · Committed today · C++ · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  3. INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

    +1 (+0.1%) in 30d · Committed 609d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  4. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  5. The open-source AI engine for AMD Strix Halo. Text, embeddings, speech, image and video models in one binary…

    +360 (+41%) in 30d · Committed today · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  6. Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp…

    +425 (+65%) in 30d · Committed today · C++ · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

  7. llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

    +231 (+36%) in 30d · Committed 3d ago · C++ · GPL-3.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  8. 37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs…

    +280 (+61%) in 30d · Committed yesterday · C · GPL-3.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  9. Local inference for diffusion language models (LLaDA, Dream), written in Mojo

    Committed yesterday · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  10. a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…

    +34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

Language
C++
License
MIT License
Contributors
1
Forks
17
Watchers
4
Open issues
0
Releases
0
Created
2026-10-21
Stars this week
+12

You've seen where AbliteratedOutTheBox stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain AbliteratedOutTheBox?

Claim this page to add your own call-to-action.

Claim this page