ResolveLab

Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents

Ta0p1/ResolveLab

View on GitHub ↗

Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents

ResolveLab ranks 86th of 97 in Reinforcement Learning / RLHF, actively maintained, last commit 12 days ago.

Star trajectory

20 days tracked
2026-11-02104 stars today2026-11-22
Momentum

- in 30d, below the Reinforcement Learning / RLHF median of +1.0%.

Maintenance

Last commit 12 days ago, fresher than the median of 40d.

How it compares in Reinforcement Learning / RLHF

ResolveLab
104
stars
- 30d
commit 12 days ago
Reinforcement Learning / RLHF median
287
stars
+1.0% 30d
commit ~40d ago
Leader · OpenRLHF
10.2k
stars
+0.6% 30d
commit 19 days ago

Ranked 86th of 97 by stars.

Ranked by shared tags, then keywords, then stars
  1. A Mac-local specialist-model factory for data, post-training, evaluation, packaging, and evidence-backed…

    +0 (+0.0%) in 30d · Committed yesterday · Swift · MIT

    Shares Reinforcement Learning / RLHF, Dataset Engineering, Evaluation & Guardrails

  2. Official code for Agent-Reflex: Teaching Language Agents to Act Reflectively

    +20 (+8.4%) in 30d · Committed 33d ago · Python · MIT

    Shares Reinforcement Learning / RLHF, Dataset Engineering, Evaluation & Guardrails

  3. Autonomous Qwen3-VL training-code research on the official DocVQA benchmark. main: NVIDIA multi-GPU, mlx…

    +0 (+0.0%) in 30d · Committed 22d ago · Python · MIT

    Shares Evaluation & Guardrails, Dataset Engineering

  4. Fine-tune an 8B LLM on a 4 GB laptop GPU, check it with real quality gates, and serve it (pip install…

    +0 in 30d · Committed 3d ago · Python · Apache-2.0

    Shares Dataset Engineering, Evaluation & Guardrails

  5. A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's…

    +251 (+29%) in 30d · Committed 33d ago · Python · Other license

    Shares Evaluation & Guardrails, Dataset Engineering

  6. Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

    +10 (+1.3%) in 30d · Committed 2d ago · Python · Apache-2.0

    Shares Evaluation & Guardrails, Dataset Engineering

  7. Open source release of the evaluation benchmark suite described in "Realistic Evaluation of Deep…

    +0 (+0.0%) in 30d · Committed 2,687d ago · Python · Apache-2.0

    Shares Dataset Engineering, Evaluation & Guardrails

  8. Benchmark for automated failure attributions in agentic systems (🏆 ICML 2025 Spotlight)

    -2 (-0.5%) in 30d · Committed 22d ago · Python · MIT

    Shares Evaluation & Guardrails, Dataset Engineering

  9. Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"

    -1 (-0.3%) in 30d · Committed 1,067d ago · Python · Apache-2.0

    Shares Dataset Engineering, Evaluation & Guardrails

  10. Compile real-world Claude Code and Codex trajectories into verified, tradable post-training assets.

    +2 (+0.7%) in 30d · Committed 21d ago · Python · Apache-2.0

    Shares Dataset Engineering, Reinforcement Learning / RLHF

Language
Python
License
MIT License
Contributors
1
Forks
0
Watchers
0
Open issues
0
Releases
2
Created
2026-10-20
Stars this week
+0

You've seen where ResolveLab stands today.

Get the moves before everyone else: the 5 Reinforcement Learning / RLHF repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain ResolveLab?

Claim this page to add your own call-to-action.

Claim this page