Skill audit report
rl-reward Audit report.
Build RL reward signals using the OpenJudge framework. Covers choosing between pointwise and pairwise reward strategies based on RL algorithm, task type, and cost; aggregating multi-dimensional pointwise scores into a scalar reward; pairwise tournament reward for GRPO on subjective tasks (net win rate across group rollouts); generating preference pairs for DPO/RLAIF; and normalizing scores for training stability. Use when building reward models, scoring rollouts for GRPO/REINFORCE, generating preference data for DPO, or doing Best-of-N selection.
OpenAgentSkill Trust Score
OpenAgentSkill Trust Score
The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.
GitHub adoption
INFO76
809 GitHub stars
Stars/forks activity
INFO71
809 stars, 65 forks; issue activity unavailable in current metadata
Recent maintenance
PASS88
3mo since push
License clarity
PASS86
Apache-2.0
README/SKILL.md completeness
PASS86
Metadata includes enough usage and workflow context
Dependency/runtime risk
INFO62
command execution surface, external package install surface
Install availability
PASS92
npx skills add agentscope-ai/OpenJudge --skill rl-reward
Install command safety
PASS92
standard package or runtime install path
Permission surface
INFO62
shell or command execution, filesystem or document access
Repository evidence
PASS86
https://github.com/agentscope-ai/OpenJudge/tree/main/skills/rl-reward
Review status
PASS88
AI review data available
Agent Proven outcomes
INFO54
No agent outcome data yet
Checks
Install and adoption review
Install path
92
npx skills add agentscope-ai/OpenJudge --skill rl-reward
Repository
88
https://github.com/agentscope-ai/OpenJudge/tree/main/skills/rl-reward
License
86
Apache-2.0
Maintenance
88
3mo since push
AI review
88
Approved with no listed issues
README/SKILL.md completeness
86
Usable description available
Dependency risk
62
command execution surface, external package install surface
Install command safety
92
standard package or runtime install path
Permission surface
62
shell or command execution, filesystem or document access
Stars/forks activity
71
809 stars, 65 forks; issue activity unavailable in current metadata
Adoption
88
809 GitHub stars
Warnings
- Quality score needs review
Method
This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.
Compare nearby options
Related skills to audit next
Frontend Design
Guidance for distinctive, intentional UI design, typography, visual direction, and non-template-like product interfaces.
183K Stars · Audit report
Taste Skill: Anti-Slop Frontend
Design and implementation guidance for distinctive landing pages, portfolios, product demos, and purposeful redesigns.
100K Stars · Audit report
Canvas Design
Create original visual art, posters, PNG assets, and PDF documents through a clear design philosophy.
183K Stars · Audit report