OpenAgentSkill
GitHub200+

Pre-install eval

shopify-admin-skills Eval report.

A machine-readable install decision for agents: task fit, Trust Score, Audit Score, install safety, permission surface, and a concrete validation plan before this skill touches a workspace.

Needs reviewMedium riskREVIEW Policy
71
Eval report
70
Trust
76
Audit
64
Agent safety

manual review

Require human approval before installing into a real workspace.

Required gates

Checks an agent must pass before install

Open JSON

Task fit

84

pass

Task wording matches this skill metadata.

  • Evaluate shopify-admin-skills before installing it in an agent workflow
  • business
  • Marketing and growth workflows; Claude Code teams; builders willing to evaluate younger projects

Install path

92

pass

Install handoff is available.

  • npx skills add 40RTY-ai/shopify-admin-skills --skill shopify-admin-skills

Install command safety

92

pass

standard package or runtime install path

  • npx skills add 40RTY-ai/shopify-admin-skills --skill shopify-admin-skills

Trust score

70

warn

Potentially useful, but at least one trust signal needs human inspection.

  • Manual review
  • 182 GitHub stars
  • MIT

Audit score

76

warn

Needs review

  • Financial research output is not financial advice; require human review before any live investment decision

Agent safety gate

64

warn

Usable candidate, but the agent should surface permission and audit notes before installation.

  • Require human approval before installing into a real workspace.
  • Financial research output is not financial advice; require human review before any live investment decision

License clarity

86

pass

MIT

  • MIT

Permission surface

100

pass

no high-risk permission surface in public metadata

  • Network access: medium

Validation plan

What the agent should do next

  1. 1Inspect repository, README/SKILL.md, license, and recent commits before production use.
  2. 2Install in an isolated workspace or sandbox with no production secrets available.
  3. 3Run the smallest representative task and record files touched, commands run, network access, and outputs.
  4. 4Compare the selected skill against at least one alternative when the eval status is review or failed.
  5. 5Promote only after the agent reports a successful verification result and unresolved warnings are accepted.

Do not use when

Conditions that require another skill

  • teams that need a vendor-supported SLA
  • production agents without a repository review
  • SKILL.md is very brief and does not enumerate or describe the sub-skills it claims to provide, making it hard for an agent to know which specific skill to invoke.
  • Financial research output is not financial advice; require human review before any live investment decision
  • No setup or authentication instructions are included in SKILL.md; they are only in CLAUDE.md, which may not be available to the agent at runtime.
  • The master skill lacks explicit input/output specifications and limitations for the overall workflow.

Supporting checks

Trust signals behind the decision

README/SKILL.md completeness

warn

76

Public metadata needs stronger README/SKILL.md context

Recent maintenance

pass

88

3mo since push

Alternatives available

pass

82

Alternative skills are available for comparison.