evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
openai/evals
View on GitHub ↗Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
evals grew +0.7% in the last 30 days, ranks 5th of 729 in Evaluation & Guardrails, last commit 192 days ago.
Star trajectory
124 days tracked2026-06-2119.6k stars today2026-10-24
Momentum
+0.7% in 30d, below the Evaluation & Guardrails median of +1.2%.
Maintenance
Last commit 192 days ago, staler than the median of 15d.
How it compares in Evaluation & Guardrails
evals
19.6k
stars
+0.7% 30d
commit 192 days ago
Evaluation & Guardrails median
249
stars
+1.2% 30d
commit ~15d ago
Leader · WeKnora
35.2k
stars
+19.5% 30d
commit today
Ranked 5th of 729 by stars.
- Language
- Python
- License
- Other
- Contributors
- 442
- Forks
- 3.1k
- Watchers
- 278
- Open issues
- 180
- Releases
- 0
- Created
- 2023-01-23
- Stars this week
- +29
You've seen where evals stands today.
Get the moves before everyone else: the 5 Evaluation & Guardrails repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.