cold-compress
Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of GPT-Fast, a simple, PyTorch-native generation codebase.
AnswerDotAI/cold-compress
View on GitHub ↗Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of GPT-Fast, a simple, PyTorch-native generation codebase.
cold-compress grew +0.0% in the last 30 days, ranks 209th of 303 in Inference Optimization, last commit 806 days ago.
Star trajectory
115 days tracked+0.0% in 30d, below the Inference Optimization median of +1.5%.
Last commit 806 days ago, staler than the median of 15d.
How it compares in Inference Optimization
Ranked 209th of 303 by stars.
- Language
- Python
- License
- BSD 3-Clause "New" or "Revised" License
- Contributors
- 22
- Forks
- 16
- Watchers
- 6
- Open issues
- 10
- Releases
- 0
- Created
- 2024-05-20
- Stars this week
- +0
You've seen where cold-compress stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.