Speculative-Decoding

Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.

romsto/Speculative-Decoding

View on GitHub ↗

Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.

Speculative-Decoding grew +0.0% in the last 30 days, ranks 244th of 303 in Inference Optimization, last commit 692 days ago.

Star trajectory

115 days tracked
2026-07-02116 stars today2026-10-25
Momentum

+0.0% in 30d, below the Inference Optimization median of +1.5%.

Maintenance

Last commit 692 days ago, staler than the median of 15d.

How it compares in Inference Optimization

Speculative-Decoding
116
stars
+0.0% 30d
commit 692 days ago
Inference Optimization median
257
stars
+1.5% 30d
commit ~15d ago
Leader · supertonic
13.8k
stars
-0.2% 30d
commit 45 days ago

Ranked 244th of 303 by stars.

Language
Python
License
MIT License
Contributors
1
Forks
25
Watchers
2
Open issues
3
Releases
0
Created
2024-04-22
Stars this week
+1

You've seen where Speculative-Decoding stands today.

Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain Speculative-Decoding?

Claim this page to add your own call-to-action.

Claim this page