SWELancer-Benchmark

This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?"

openai/SWELancer-Benchmark

View on GitHub ↗

This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?"

SWELancer-Benchmark grew +0.2% in the last 30 days, ranks 90th of 744 in Evaluation & Guardrails, last commit 465 days ago.

Star trajectory

116 days tracked
2026-07-021.4k stars today2026-10-26
Momentum

+0.2% in 30d, below the Evaluation & Guardrails median of +1.2%.

Maintenance

Last commit 465 days ago, staler than the median of 14d.

How it compares in Evaluation & Guardrails

SWELancer-Benchmark
1.4k
stars
+0.2% 30d
commit 465 days ago
Evaluation & Guardrails median
242.5
stars
+1.2% 30d
commit ~14d ago
Leader · WeKnora
35.5k
stars
+17.6% 30d
commit today

Ranked 90th of 744 by stars.

Language
-
License
-
Contributors
10
Forks
135
Watchers
1
Open issues
0
Releases
0
Created
2025-02-18
Stars this week
+1

You've seen where SWELancer-Benchmark stands today.

Get the moves before everyone else: the 5 Evaluation & Guardrails repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain SWELancer-Benchmark?

Claim this page to add your own call-to-action.

Claim this page