STEPQuant

STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization

Dreamer-Toby/STEPQuant

View on GitHub ↗

STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization

STEPQuant grew +11.6% in the last 30 days, ranks 96th of 108 in Model Optimization, last commit 30 days ago.

Star trajectory

50 days tracked
2026-10-03106 stars today2026-11-22
Momentum

+11.6% in 30d, above the Model Optimization median of +0.6%.

Maintenance

Last commit 30 days ago, fresher than the median of 43.5d.

How it compares in Model Optimization

STEPQuant
106
stars
+11.6% 30d
commit 30 days ago
Model Optimization median
271
stars
+0.6% 30d
commit ~43.5d ago
Leader · kimi-k3-in-c
12.6k
stars
+37.0% 30d
commit 5 days ago

Ranked 96th of 108 by stars.

Ranked by shared tags, then keywords, then stars

Where STEPQuant sits

Hover or focus a node for details. Click to open it.

  • This repo
  • Related repo
  • Tag or category
  1. A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS…

    +3.4k (+37%) in 30d · Committed 5d ago · C · Apache-2.0

    Shares Inference Optimization, Model Optimization

  2. 2bit quants, kernels and runtime for consumer devices.

    Committed 16d ago · C++ · Other license

    Shares Inference Optimization, Model Optimization

  3. Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127…

    +592 (+27%) in 30d · Committed 12d ago · Python · Apache-2.0

    Shares Inference Optimization, Model Optimization

  4. Run Mixtral-8x7B models in Colab or consumer desktops

    -3 (-0.1%) in 30d · Committed 957d ago · Python · MIT

    Shares Inference Optimization, Model Optimization

  5. Run a 1-billion parameter LLM on a $10 board with 256MB RAM

    +6 (+0.3%) in 30d · Committed 272d ago · C · MIT

    Shares Inference Optimization, Model Optimization

  6. 一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

    +17 (+0.9%) in 30d · Committed 2d ago · C++ · Apache-2.0

    Shares Model Optimization, Inference Optimization

  7. INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

    +1 (+0.1%) in 30d · Committed 609d ago · C++ · MIT

    Shares Inference Optimization, Model Optimization

  8. Open deep learning compiler stack for Kendryte AI accelerators ✨

    +2 (+0.2%) in 30d · Committed 127d ago · C# · Apache-2.0

    Shares Inference Optimization, Model Optimization

  9. Suno AI's Bark model in C/C++ for fast text-to-speech generation

    +0 (+0.0%) in 30d · Committed 735d ago · C++ · MIT

    Shares Inference Optimization, Model Optimization

  10. RDNA-native LLM inference engine in Rust.

    +95 (+13%) in 30d · Committed today · Rust · Other license

    Shares Inference Optimization, Model Optimization

Language
Python
License
-
Contributors
2
Forks
2
Watchers
0
Open issues
1
Releases
0
Created
2026-09-29
Stars this week
+2

You've seen where STEPQuant stands today.

Get the moves before everyone else: the 5 Model Optimization repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain STEPQuant?

Claim this page to add your own call-to-action.

Claim this page