PatchEval

PatchEval: A New Benchmark for Evaluating LLMs on Patching Real-World Vulnerabilities

bytedance/PatchEval

View on GitHub ↗

PatchEval: A New Benchmark for Evaluating LLMs on Patching Real-World Vulnerabilities

PatchEval grew +1.3% in the last 30 days, ranks 87th of 147 in Dataset Engineering, actively maintained, last commit 6 days ago.

Star trajectory

115 days tracked
2026-07-02234 stars today2026-10-25
Momentum

+1.3% in 30d, above the Dataset Engineering median of +0.0%.

Maintenance

Last commit 6 days ago, fresher than the median of 312d.

How it compares in Dataset Engineering

PatchEval
234
stars
+1.3% 30d
commit 6 days ago
Dataset Engineering median
273
stars
+0.0% 30d
commit ~312d ago
Leader · olmocr
19.8k
stars
+0.7% 30d
commit 213 days ago

Ranked 87th of 147 by stars.

Language
Python
License
Apache License 2.0
Contributors
9
Forks
24
Watchers
2
Open issues
1
Releases
0
Created
2025-08-27
Stars this week
+1

You've seen where PatchEval stands today.

Get the moves before everyone else: the 5 Dataset Engineering repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain PatchEval?

Claim this page to add your own call-to-action.

Claim this page