helm

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

stanford-crfm/helm

View on GitHub ↗

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

helm grew +1.3% in the last 30 days, ranks 386th of 4,497 in Tools & Integrations, last commit 55 days ago.

Star trajectory

126 days tracked
2026-06-213k stars today2026-10-26
Momentum

+1.3% in 30d, below the Tools & Integrations median of +1.7%.

Maintenance

Last commit 55 days ago, staler than the median of 13d.

How it compares in Tools & Integrations

helm
3k
stars
+1.3% 30d
commit 55 days ago
Tools & Integrations median
302
stars
+1.7% 30d
commit ~13d ago
Leader · rea
386.1k
stars
+92948.2% 30d
commit today

Ranked 386th of 4,497 by stars.

Language
Python
License
Apache License 2.0
Contributors
153
Forks
427
Watchers
39
Open issues
70
Releases
25
Created
2021-11-29
Stars this week
+7

You've seen where helm stands today.

Get the moves before everyone else: the 5 Tools & Integrations repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain helm?

Claim this page to add your own call-to-action.

Claim this page