evaluation-guidebook

Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

huggingface/evaluation-guidebook

View on GitHub ↗

Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

evaluation-guidebook grew +0.6% in the last 30 days, ranks 58th of 729 in Evaluation & Guardrails, last commit 323 days ago.

Star trajectory

123 days tracked
2026-06-212.2k stars today2026-10-23
Momentum

+0.6% in 30d, below the Evaluation & Guardrails median of +1.1%.

Maintenance

Last commit 323 days ago, staler than the median of 14d.

How it compares in Evaluation & Guardrails

evaluation-guidebook
2.2k
stars
+0.6% 30d
commit 323 days ago
Evaluation & Guardrails median
247
stars
+1.1% 30d
commit ~14d ago
Leader · WeKnora
35.1k
stars
+20.6% 30d
commit today

Ranked 58th of 729 by stars.

Language
Jupyter Notebook
License
Other
Contributors
13
Forks
126
Watchers
15
Open issues
4
Releases
0
Created
2024-10-09
Stars this week
+3

You've seen where evaluation-guidebook stands today.

Get the moves before everyone else: the 5 Evaluation & Guardrails repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain evaluation-guidebook?

Claim this page to add your own call-to-action.

Claim this page