socbench

An Open Harness and Benchmark for AI in Cybersecurity Operations.

DeepTempo/socbench

View on GitHub ↗

An Open Harness and Benchmark for AI in Cybersecurity Operations.

socbench grew +4.5% in the last 30 days, ranks 783rd of 872 in Evaluation & Guardrails, actively maintained, last commit 2 days ago.

Star trajectory

82 days tracked
2026-08-3170 stars today2026-11-22
Momentum

+4.5% in 30d, above the Evaluation & Guardrails median of +1.4%.

Maintenance

Last commit 2 days ago, fresher than the median of 15d.

How it compares in Evaluation & Guardrails

socbench
70
stars
+4.5% 30d
commit 2 days ago
Evaluation & Guardrails median
235
stars
+1.4% 30d
commit ~15d ago
Leader · impeccable
114.7k
stars
+0.0% 30d
commit today

Ranked 783rd of 872 by stars.

Ranked by shared tags, then keywords, then stars
  1. LLM Agent and Evaluation Framework for Autonomous Penetration Testing

    +5 (+1.6%) in 30d · Committed 515d ago · Python · AGPL-3.0

    Shares Agent SDK / Framework, Evaluation & Guardrails

  2. Official Repository for QuantHarness

    +24 (+0.8%) in 30d · Committed 95d ago · HTML · MIT

    Shares Evaluation & Guardrails, Agent SDK / Framework

  3. Open-source benchmark for browser AI agents on daily tasks.

    +246 (+23%) in 30d · Committed 16d ago · Python · Apache-2.0

    Shares Evaluation & Guardrails, Agent SDK / Framework

  4. Official AHE code — Agentic Harness Engineering: observability-driven automatic evolution of coding-agent…

    +46 (+4.9%) in 30d · Committed 22d ago · Python · MIT

    Shares Agent SDK / Framework, Evaluation & Guardrails

  5. Adversarial AI bug hunter with auto-fix skill for Claude Code, Cursor, Codex CLI, GitHub Copilot CLI, Kiro…

    +44 (+8.3%) in 30d · Committed 23d ago · JavaScript · MIT

    Shares Agent SDK / Framework, Evaluation & Guardrails

  6. Bring your own agent and build a self-improving agentic system. Automatically mine failures, optimize the…

    +5 (+0.9%) in 30d · Committed 66d ago · Python · MIT

    Shares Agent SDK / Framework, Evaluation & Guardrails

  7. An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]

    +4 (+0.9%) in 30d · Committed 915d ago · SAS

    Shares Evaluation & Guardrails, Agent SDK / Framework

  8. Give a coding agent a brief, not a chat, and it works on its own across sessions. Includes an example run: an…

    +4 (+1.0%) in 30d · Committed 34d ago · TypeScript · MIT

    Shares Agent SDK / Framework, Evaluation & Guardrails

  9. Benchmarking Agentic LLM and VLM Reasoning On Games

    +3 (+1.1%) in 30d · Committed 226d ago · Python · MIT

    Shares Evaluation & Guardrails, Agent SDK / Framework

  10. Evolutionary multi-agent runtime that breeds, evaluates, and improves autonomous agents across reproducible…

    -3 (-1.2%) in 30d · Committed 28d ago · Python · Apache-2.0

    Shares Agent SDK / Framework, Evaluation & Guardrails

Language
Python
License
Apache License 2.0
Contributors
2
Forks
10
Watchers
1
Open issues
4
Releases
0
Created
2026-06-09
Stars this week
+0

You've seen where socbench stands today.

Get the moves before everyone else: the 5 Evaluation & Guardrails repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain socbench?

Claim this page to add your own call-to-action.

Claim this page