long-context-attention

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

feifeibear/long-context-attention

View on GitHub ↗

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

long-context-attention grew +0.1% in the last 30 days, ranks 189th of 494 in Local Runtime / Inference Engine, last commit 39 days ago.

Star trajectory

125 days tracked
2026-06-21696 stars today2026-10-25
Momentum

+0.1% in 30d, below the Local Runtime / Inference Engine median of +1.7%.

Maintenance

Last commit 39 days ago, staler than the median of 5d.

How it compares in Local Runtime / Inference Engine

long-context-attention
696
stars
+0.1% 30d
commit 39 days ago
Local Runtime / Inference Engine median
414
stars
+1.7% 30d
commit ~5d ago
Leader · ollama
184.7k
stars
+1.7% 30d
commit today

Ranked 189th of 494 by stars.

Language
Python
License
Apache License 2.0
Contributors
27
Forks
87
Watchers
5
Open issues
11
Releases
18
Created
2024-03-27
Stars this week
+0

You've seen where long-context-attention stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain long-context-attention?

Claim this page to add your own call-to-action.

Claim this page