qa-automation-ai-agent-evals

A provider-neutral quality-engineering framework for evaluating autonomous agents by observable outcomes, side effects, authority boundaries, approval intent, adversarial conditions, verified evaluation preconditions, protocol state, authorization behavior, reliability, and reproducible evidence—not by persuasive final prose.

portyu9/qa-automation-ai-agent-evals

View on GitHub ↗

A provider-neutral quality-engineering framework for evaluating autonomous agents by observable outcomes, side effects, authority boundaries, approval intent, adversarial conditions, verified evaluation preconditions, protocol state, authorization behavior, reliability, and reproducible evidence—not by persuasive final prose.

qa-automation-ai-agent-evals ranks 765th of 872 in Evaluation & Guardrails, actively maintained, last commit 5 days ago.

Star trajectory

27 days tracked
2026-10-2679 stars today2026-11-22
Momentum

- in 30d, below the Evaluation & Guardrails median of +1.4%.

Maintenance

Last commit 5 days ago, fresher than the median of 15d.

How it compares in Evaluation & Guardrails

qa-automation-ai-agent-evals
79
stars
- 30d
commit 5 days ago
Evaluation & Guardrails median
235
stars
+1.4% 30d
commit ~15d ago
Leader · impeccable
114.7k
stars
+0.0% 30d
commit today

Ranked 765th of 872 by stars.

Ranked by shared tags, then keywords, then stars

Where qa-automation-ai-agent-evals sits

Hover or focus a node for details. Click to open it.

  • This repo
  • Related repo
  • Tag or category
  1. Open-source agentic security operations platform:

    Committed 3d ago · Python · MIT

    Shares Evaluation & Guardrails

  2. Tracekit records what your AI agents do, decides each tool call before it runs, and gives you a signed record…

    +649 (+433%) in 30d · Committed today · Python · MIT

    Shares Evaluation & Guardrails

  3. SlowMist Agent Security Skill: A comprehensive security review framework for AI agents operating in…

    +51 (+10%) in 30d · Committed 219d ago · MIT

    Shares Evaluation & Guardrails

  4. 数据面具 Data Maskit — 专为大模型打造的本地隐私脱敏网关(请求自动打码,回复流式还原;支持 Cursor / Claude Code / Codex / Pi 等任意可配 Base URL 工具)

    +36 (+12%) in 30d · Committed 2d ago · Python · AGPL-3.0

    Shares Evaluation & Guardrails

  5. Static security scanner for LLM agents — prompt injection, MCP config auditing, taint analysis. 51 rules…

    +8 (+3.3%) in 30d · Committed 69d ago · Python · MIT

    Shares Evaluation & Guardrails

  6. Open-source AI security verification for model artifacts, live endpoints, MCP servers, and recorded agent…

    -26 (-10%) in 30d · Committed today · Python · Apache-2.0

    Shares Evaluation & Guardrails

  7. Access control for AI agents. Set what Claude Code, Codex, Gemini, Cursor and any MCP server are allowed to…

    +6 (+2.7%) in 30d · Committed today · TypeScript · Apache-2.0

    Shares Evaluation & Guardrails

  8. +1 (+0.5%) in 30d · Committed 32d ago · JavaScript · AGPL-3.0

    Shares Evaluation & Guardrails

  9. Wireshark-like forensic analysis for Model Context Protocol communications Capture, inspect, and investigate…

    +0 (+0.0%) in 30d · Committed 209d ago · JavaScript · Other license

    Shares Evaluation & Guardrails

  10. Independent security verification for code written by humans and AI agents. Scan, repair, then prove it —…

    +3 (+2.5%) in 30d · Committed yesterday · TypeScript · MIT

    Shares Evaluation & Guardrails

Language
Python
License
MIT License
Contributors
3
Forks
0
Watchers
0
Open issues
0
Releases
1
Created
2026-09-03
Stars this week
+0

You've seen where qa-automation-ai-agent-evals stands today.

Get the moves before everyone else: the 5 Evaluation & Guardrails repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain qa-automation-ai-agent-evals?

Claim this page to add your own call-to-action.

Claim this page