Skill audit report

rl-reward Audit report.

Build RL reward signals using the OpenJudge framework. Covers choosing between pointwise and pairwise reward strategies based on RL algorithm, task type, and cost; aggregating multi-dimensional pointwise scores into a scalar reward; pairwise tournament reward for GRPO on subjective tasks (net win rate across group rollouts); generating preference pairs for DPO/RLAIF; and normalizing scores for training stability. Use when building reward models, scoring rollouts for GRPO/REINFORCE, generating preference data for DPO, or doing Best-of-N selection.

EXPERIMENTAL · REVIEWNeeds reviewGenerated Oct 21, 2026Heuristic metadata audit
79
Audit
78
Trust
70
Quality
82
Security
88
Maintain
92
Install

OpenAgentSkill Trust Score

78
Strong shortlist

OpenAgentSkill Trust Score

The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.

GitHub adoption

INFO

76

809 GitHub stars

Stars/forks activity

INFO

71

809 stars, 65 forks; issue activity unavailable in current metadata

Recent maintenance

PASS

88

3mo since push

License clarity

PASS

86

Apache-2.0

README/SKILL.md completeness

PASS

86

Metadata includes enough usage and workflow context

Dependency/runtime risk

INFO

62

command execution surface, external package install surface

Install availability

PASS

92

npx skills add agentscope-ai/OpenJudge --skill rl-reward

Install command safety

PASS

92

standard package or runtime install path

Permission surface

INFO

62

shell or command execution, filesystem or document access

Repository evidence

PASS

86

https://github.com/agentscope-ai/OpenJudge/tree/main/skills/rl-reward

Review status

PASS

88

AI review data available

Agent Proven outcomes

INFO

54

No agent outcome data yet

Checks

Install and adoption review

8 Passed · 4 Needs review

Install path

92

PASS

npx skills add agentscope-ai/OpenJudge --skill rl-reward

Repository

88

PASS

https://github.com/agentscope-ai/OpenJudge/tree/main/skills/rl-reward

License

86

PASS

Apache-2.0

Maintenance

88

PASS

3mo since push

AI review

88

PASS

Approved with no listed issues

README/SKILL.md completeness

86

PASS

Usable description available

Dependency risk

62

CHECK

command execution surface, external package install surface

Install command safety

92

PASS

standard package or runtime install path

Permission surface

62

CHECK

shell or command execution, filesystem or document access

Stars/forks activity

71

CHECK

809 stars, 65 forks; issue activity unavailable in current metadata

Adoption

88

PASS

809 GitHub stars

Warnings

  • Quality score needs review

Method

This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.

Compare nearby options

Related skills to audit next