lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

EvolvingLMMs-Lab/lmms-eval

View on GitHub ↗

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

lmms-eval grew +0.8% in the last 30 days, ranks 1st of 71 in Interpretability & Alignment, actively maintained, last commit 4 days ago.

Star trajectory

116 days tracked
2026-07-024.5k stars today2026-10-26
Momentum

+0.8% in 30d, above the Interpretability & Alignment median of +0.2%.

Maintenance

Last commit 4 days ago, fresher than the median of 203d.

How it compares in Interpretability & Alignment

lmms-eval
4.5k
stars
+0.8% 30d
commit 4 days ago
Interpretability & Alignment median
298
stars
+0.2% 30d
commit ~203d ago
Category leader
4.5k
stars
- 30d
you lead

Ranked 1st of 71 by stars.

Language
Python
License
Other
Contributors
248
Forks
677
Watchers
10
Open issues
30
Releases
23
Created
2024-03-07
Stars this week
+6

You've seen where lmms-eval stands today.

Get the moves before everyone else: the 5 Interpretability & Alignment repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain lmms-eval?

Claim this page to add your own call-to-action.

Claim this page