AbliteratedOutTheBox
llama.cpp fork that abliterates at inference
heterodoxin/AbliteratedOutTheBox
View on GitHub ↗llama.cpp fork that abliterates at inference
AbliteratedOutTheBox ranks 349th of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.
Star trajectory
27 days tracked- in 30d, below the Local Runtime / Inference Engine median of +1.9%.
Last commit today, fresher than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 349th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere AbliteratedOutTheBox sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS…
+3.4k (+37%) in 30d · Committed 5d ago · C · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization
- ROCm/FastFlowLM2.1k
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
+97 (+4.9%) in 30d · Committed today · C++ · Other license
Shares Local Runtime / Inference Engine, Inference Optimization
- RWKV/rwkv.cpp1.6k
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
+1 (+0.1%) in 30d · Committed 609d ago · C++ · MIT
Shares Local Runtime / Inference Engine, Inference Optimization
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…
+962 (+243%) in 30d · Committed 3d ago · C++ · MIT
Shares Local Runtime / Inference Engine, Inference Optimization
- gufo-org/gufo1.2k
The open-source AI engine for AMD Strix Halo. Text, embeddings, speech, image and video models in one binary…
+360 (+41%) in 30d · Committed today · C++ · MIT
Shares Local Runtime / Inference Engine, Inference Optimization
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp…
+425 (+65%) in 30d · Committed today · C++ · Apache-2.0
Shares Inference Optimization, Local Runtime / Inference Engine
llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
+231 (+36%) in 30d · Committed 3d ago · C++ · GPL-3.0
Shares Local Runtime / Inference Engine, Inference Optimization
37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs…
+280 (+61%) in 30d · Committed yesterday · C · GPL-3.0
Shares Local Runtime / Inference Engine, Inference Optimization
Local inference for diffusion language models (LLaDA, Dream), written in Mojo
Committed yesterday · Python · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization
a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features…
+34 (+7.5%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization
- Language
- C++
- License
- MIT License
- Contributors
- 1
- Forks
- 17
- Watchers
- 4
- Open issues
- 0
- Releases
- 0
- Created
- 2026-10-21
- Stars this week
- +12
You've seen where AbliteratedOutTheBox stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.