XRepoTest
[EMNLP 2026] A multilingual benchmark for repository-level unit test generation, evaluating LLMs across 5 programming languages and real-world code under reproducible, Docker-based execution.
solis-team/XRepoTest
View on GitHub ↗[EMNLP 2026] A multilingual benchmark for repository-level unit test generation, evaluating LLMs across 5 programming languages and real-world code under reproducible, Docker-based execution.
XRepoTest grew +0.6% in the last 30 days, ranks 116th of 165 in Dataset Engineering, last commit 86 days ago.
Star trajectory
71 days tracked+0.6% in 30d, above the Dataset Engineering median of +0.2%.
Last commit 86 days ago, fresher than the median of 224d.
How it compares in Dataset Engineering
Ranked 116th of 165 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere XRepoTest sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Autonomous Qwen3-VL training-code research on the official DocVQA benchmark. main: NVIDIA multi-GPU, mlx…
+0 (+0.0%) in 30d · Committed 22d ago · Python · MIT
Shares Evaluation & Guardrails, Dataset Engineering
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's…
+251 (+29%) in 30d · Committed 33d ago · Python · Other license
Shares Evaluation & Guardrails, Dataset Engineering
Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool
+10 (+1.3%) in 30d · Committed 2d ago · Python · Apache-2.0
Shares Evaluation & Guardrails, Dataset Engineering
Open source release of the evaluation benchmark suite described in "Realistic Evaluation of Deep…
+0 (+0.0%) in 30d · Committed 2,687d ago · Python · Apache-2.0
Shares Dataset Engineering, Evaluation & Guardrails
Benchmark for automated failure attributions in agentic systems (🏆 ICML 2025 Spotlight)
-2 (-0.5%) in 30d · Committed 22d ago · Python · MIT
Shares Evaluation & Guardrails, Dataset Engineering
Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
-1 (-0.3%) in 30d · Committed 1,067d ago · Python · Apache-2.0
Shares Dataset Engineering, Evaluation & Guardrails
Official code for Agent-Reflex: Teaching Language Agents to Act Reflectively
+20 (+8.4%) in 30d · Committed 33d ago · Python · MIT
Shares Dataset Engineering, Evaluation & Guardrails
A unified, downstream-grounded benchmark for LLM-driven training data construction, selection, and quality…
+1 (+0.4%) in 30d · Committed 19d ago · Python
Shares Dataset Engineering, Evaluation & Guardrails
PatchEval: A New Benchmark for Evaluating LLMs on Patching Real-World Vulnerabilities
+4 (+1.7%) in 30d · Committed 34d ago · Python · Apache-2.0
Shares Dataset Engineering, Evaluation & Guardrails
A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in Large Language Models
+0 (+0.0%) in 30d · Committed 172d ago · Python · MIT
Shares Evaluation & Guardrails, Dataset Engineering
- Language
- Python
- License
- Other
- Contributors
- 2
- Forks
- 0
- Watchers
- 0
- Open issues
- 0
- Releases
- 0
- Created
- 2026-08-24
- Stars this week
- +0
You've seen where XRepoTest stands today.
Get the moves before everyone else: the 5 Dataset Engineering repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.