Star0

Pre-install eval

MedAgents eval report.

A machine-readable install decision for agents: task fit, Trust Score, Audit Score, install safety, permission surface, and a concrete validation plan before this skill touches a workspace.

Needs reviewMEDIUM RISKREVIEW POLICY
60
Eval
69
Trust
61
Audit
45
Safety

manual review

Test manually in an isolated workspace and compare against safer alternatives.

Required gates

Checks an agent must pass before install

Open JSON

Task fit

94

pass

Task wording matches this skill metadata.

  • Evaluate MedAgents before installing it in an agent workflow
  • agent-frameworks
  • Coding agents workflows; Claude Code teams; builders willing to evaluate younger projects

Install path

92

pass

Install handoff is available.

  • npx skills add gersteinlab/MedAgents

Install command safety

92

pass

standard package or runtime install path

  • npx skills add gersteinlab/MedAgents

Trust score

69

warn

Potentially useful, but at least one trust signal needs human inspection.

  • Manual review
  • 350 GitHub stars
  • Unknown

Audit score

61

warn

Needs review

  • License is unclear

Agent safety gate

45

warn

Sparse or mixed signals. Useful for discovery, but not for autonomous installation.

  • Test manually in an isolated workspace and compare against safer alternatives.
  • License is unclear

License clarity

42

warn

Unknown

  • Unknown

Permission surface

86

pass

filesystem or document access

  • Network access: medium
  • Filesystem access: medium

Validation plan

What the agent should do next

  1. 1Inspect repository, README/SKILL.md, license, and recent commits before production use.
  2. 2Install in an isolated workspace or sandbox with no production secrets available.
  3. 3Run the smallest representative task and record files touched, commands run, network access, and outputs.
  4. 4Compare the selected skill against at least one alternative when the eval status is review or failed.
  5. 5Promote only after the agent reports a successful verification result and unresolved warnings are accepted.

Do not use when

Conditions that require another skill

  • teams that require actively maintained dependencies
  • production agents without a repository review
  • Repository looks stale
  • License is unclear
  • Repository appears stale
  • Quality score needs review

Supporting checks

Trust signals behind the decision

README/SKILL.md completeness

pass

90

Metadata includes enough usage and workflow context

Recent maintenance

fail

22

2y since push

Alternatives available

pass

82

Alternative skills are available for comparison.