Pre-install eval

web3-solidity-audit-mcp Eval report.

A machine-readable install decision for agents: task fit, Trust Score, Audit Score, install safety, permission surface, and a concrete validation plan before this skill touches a workspace.

FailedHigh riskBLOCK Policy
63
Eval report
64
Trust
72
Audit
32
Agent safety

do not auto install

Audit score: Risky

Required gates

Checks an agent must pass before install

Open JSON

Task fit

94

pass

Task wording matches this skill metadata.

  • Evaluate web3-solidity-audit-mcp before installing it in an agent workflow
  • security
  • Testing and QA workflows; Claude Code teams; builders willing to evaluate younger projects

Install path

92

pass

Install handoff is available.

  • npx skills add Awarexone/web3-bug-bounty-hunting-ai-skills --skill web3-solidity-audit-mcp

Install command safety

92

pass

standard package or runtime install path

  • npx skills add Awarexone/web3-bug-bounty-hunting-ai-skills --skill web3-solidity-audit-mcp

Trust score

64

warn

Potentially useful, but at least one trust signal needs human inspection.

  • Manual review
  • 156 GitHub stars
  • MIT

Audit score

72

fail

Risky

  • Dependency or permission surface needs review

Agent safety gate

32

fail

This skill should not be selected by an agent without explicit human security review.

  • Do not auto-install. Inspect the source, dependencies, and permission surface first.
  • Audit risk exceeds the requested agent policy

License clarity

86

pass

MIT

  • MIT

Permission surface

22

fail

secrets or environment access, shell or command execution

  • Shell or command execution: high
  • Network access: medium
  • Filesystem access: medium

Validation plan

What the agent should do next

  1. 1Inspect repository, README/SKILL.md, license, and recent commits before production use.
  2. 2Install in an isolated workspace or sandbox with no production secrets available.
  3. 3Run the smallest representative task and record files touched, commands run, network access, and outputs.
  4. 4Compare the selected skill against at least one alternative when the eval status is review or failed.
  5. 5Promote only after the agent reports a successful verification result and unresolved warnings are accepted.

Do not use when

Conditions that require another skill

  • teams that need a vendor-supported SLA
  • production agents without a repository review
  • No explicit security warnings about running analysis on untrusted or malicious contracts, which could potentially exploit the tooling.
  • No OpenAgentSkill engagement data yet
  • Audit risk risky exceeds max_risk=medium
  • High-risk permission hints: Shell or command execution, Secrets or environment access

Supporting checks

Trust signals behind the decision

README/SKILL.md completeness

pass

86

Metadata includes enough usage and workflow context

Recent maintenance

pass

88

2mo since push

Alternatives available

info

55

No close alternatives were found in the current shortlist.