Skill audit report

metric-design Audit report.

Use when the user has evaluation principles or a dataset but needs help choosing the right graders, designing evaluation metrics, creating LLM-as-judge prompts, combining multiple metrics into a composite score, or building an automated evaluation pipeline. Also use when the user mentions grader selection, metric design, judge prompt engineering, rubric design, evaluation pipeline code, or "how to evaluate [X] automatically." Outputs executable OpenJudge pipeline code.

REVIEWED · REVIEWNeeds reviewGenerated Nov 7, 2026Heuristic metadata audit
76
Audit
72
Trust
70
Quality
80
Security
76
Maintain
92
Install

OpenAgentSkill Trust Score

72
Strong shortlist

OpenAgentSkill Trust Score

The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.

GitHub adoption

INFO

76

816 GitHub stars

Stars/forks activity

INFO

71

816 stars, 65 forks; issue activity unavailable in current metadata

Recent maintenance

INFO

76

3mo since push

License clarity

PASS

86

Apache-2.0

README/SKILL.md completeness

PASS

86

Metadata includes enough usage and workflow context

Dependency/runtime risk

INFO

72

external package install surface, database surface

Install availability

PASS

92

npx skills add agentscope-ai/OpenJudge --skill metric-design

Install command safety

PASS

92

standard package or runtime install path

Permission surface

PASS

88

database access

Repository evidence

PASS

86

https://github.com/agentscope-ai/OpenJudge/tree/main/skills/eval_pipeline/02-metric-design

Review status

INFO

66

AI review data available

Agent Proven outcomes

INFO

54

No agent outcome data yet

Checks

Install and adoption review

7 Passed · 7 Needs review

Install path

92

PASS

npx skills add agentscope-ai/OpenJudge --skill metric-design

Repository

88

PASS

https://github.com/agentscope-ai/OpenJudge/tree/main/skills/eval_pipeline/02-metric-design

License

86

PASS

Apache-2.0

Maintenance

76

CHECK

3mo since push

AI review

55

CHECK

The SKILL.md excerpt is truncated; the full document may contain additional details, but the provided content is coherent and actionable.

README/SKILL.md completeness

86

PASS

Usable description available

Dependency risk

72

CHECK

external package install surface, database surface

Install command safety

92

PASS

standard package or runtime install path

Permission surface

88

PASS

database access

Stars/forks activity

71

CHECK

816 stars, 65 forks; issue activity unavailable in current metadata

Adoption

88

PASS

816 GitHub stars

Warnings

  • The SKILL.md excerpt is truncated; the full document may contain additional details, but the provided content is coherent and actionable.
  • The skill is tightly coupled to the OpenJudge SDK, which may limit portability to other evaluation harnesses, though the design logic is still applicable.
  • Quality score needs review

Method

This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.

Compare nearby options

Related skills to audit next