Pre-install eval

RNSkill Production Captions eval report.

A machine-readable install decision for agents: task fit, Trust Score, Audit Score, install safety, permission surface, and a concrete validation plan before this skill touches a workspace.

FailedHIGH RISKBLOCK POLICY
82
Eval
76
Trust
85
Audit
73
Safety

do not auto install

License clarity: CC-BY-NC-4.0 (repository; verify skill-level terms)

Required gates

Checks an agent must pass before install

Open JSON

Task fit

94

pass

Task wording matches this skill metadata.

  • Evaluate RNSkill Production Captions before installing it in an agent workflow
  • Video Creation
  • Coding agents workflows; Claude Code teams; teams that value GitHub adoption signals

Install path

92

pass

Install handoff is available.

  • npx -y skills add Pluviobyte/rnskill --skill skill-captions

Install command safety

92

pass

standard package or runtime install path

  • npx -y skills add Pluviobyte/rnskill --skill skill-captions

Trust score

76

warn

Good trust signals with a few areas worth checking before rollout.

  • Strong shortlist
  • 823 GitHub stars
  • CC-BY-NC-4.0 (repository; verify skill-level terms)

Audit score

85

warn

Needs review

  • License restricts commercial reuse

Agent safety gate

73

warn

Usable candidate, but the agent should surface permission and audit notes before installation.

  • Require human approval before installing into a real workspace.
  • License restricts commercial reuse

License clarity

58

fail

CC-BY-NC-4.0 (repository; verify skill-level terms)

  • CC-BY-NC-4.0 (repository; verify skill-level terms)

Permission surface

100

pass

no high-risk permission surface in public metadata

  • Network access: medium

Validation plan

What the agent should do next

  1. 1Inspect repository, README/SKILL.md, license, and recent commits before production use.
  2. 2Install in an isolated workspace or sandbox with no production secrets available.
  3. 3Run the smallest representative task and record files touched, commands run, network access, and outputs.
  4. 4Compare the selected skill against at least one alternative when the eval status is review or failed.
  5. 5Promote only after the agent reports a successful verification result and unresolved warnings are accepted.

Do not use when

Conditions that require another skill

  • teams that need a vendor-supported SLA
  • production agents without a repository review
  • The documented caption style is repository-specific and needs visual review in the target format.
  • No OpenAgentSkill engagement data yet
  • License restricts commercial reuse
  • Repository content is licensed non-commercially; confirm the intended use before commercial reuse.

Supporting checks

Trust signals behind the decision

README/SKILL.md completeness

pass

90

Metadata includes enough usage and workflow context

Recent maintenance

pass

100

1d since push

Alternatives available

pass

82

Alternative skills are available for comparison.