Skill audit report

prompt-regression Audit report.

Use when the user has changed a prompt (system prompt, RAG template, agent instruction, etc.) and wants to know whether the candidate is better or worse than the baseline. Also use when the user mentions prompt A/B testing, prompt comparison, prompt optimization validation, "did my prompt change help," or prompt regression testing. Outputs per-dimension win rates with statistical significance using OpenJudge PairwiseAnalyzer.

BLOCKED · BLOCKRiskyGenerated Nov 6, 2026Heuristic metadata audit
75
Audit
71
Trust
70
Quality
79
Security
76
Maintain
92
Install

OpenAgentSkill Trust Score

71
Manual review

OpenAgentSkill Trust Score

The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.

GitHub adoption

INFO

76

816 GitHub stars

Stars/forks activity

INFO

71

816 stars, 65 forks; issue activity unavailable in current metadata

Recent maintenance

INFO

76

3mo since push

License clarity

PASS

86

Apache-2.0

README/SKILL.md completeness

PASS

86

Metadata includes enough usage and workflow context

Dependency/runtime risk

INFO

72

command execution surface

Install availability

PASS

92

npx skills add agentscope-ai/OpenJudge --skill prompt-regression

Install command safety

PASS

92

standard package or runtime install path

Permission surface

INFO

64

shell or command execution, database access

Repository evidence

PASS

86

https://github.com/agentscope-ai/OpenJudge/tree/main/skills/eval_pipeline/06-prompt-regression

Review status

INFO

66

AI review data available

Agent Proven outcomes

INFO

54

No agent outcome data yet

Checks

Install and adoption review

6 Passed · 10 Needs review

Install path

92

PASS

npx skills add agentscope-ai/OpenJudge --skill prompt-regression

Repository

88

PASS

https://github.com/agentscope-ai/OpenJudge/tree/main/skills/eval_pipeline/06-prompt-regression

License

86

PASS

Apache-2.0

Maintenance

76

CHECK

3mo since push

AI review

55

CHECK

The full implementation of scripts/pairwise.py is not visible in the excerpt, but the provided portion indicates a well-structured, stdlib-only script with clear usage and exit codes.

README/SKILL.md completeness

86

PASS

Usable description available

Dependency risk

72

CHECK

command execution surface

Install command safety

92

PASS

standard package or runtime install path

Permission surface

64

CHECK

shell or command execution, database access

Stars/forks activity

71

CHECK

816 stars, 65 forks; issue activity unavailable in current metadata

Adoption

88

PASS

816 GitHub stars

Warnings

  • Potential broker, wallet, exchange, or real-money execution surface; sandbox and explicit approval are required
  • The full implementation of scripts/pairwise.py is not visible in the excerpt, but the provided portion indicates a well-structured, stdlib-only script with clear usage and exit codes.
  • The skill relies on the user to correctly generate the comparisons.jsonl file with swapped rows; no automated validation is provided for that input format.
  • This skill may touch real-money trading, broker, wallet, or exchange operations; use only in a sandbox with explicit approval.
  • Quality score needs review

Method

This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.

Compare nearby options

Related skills to audit next