Pre-install eval

maintaining-dbt-documentation Eval report.

A machine-readable install decision for agents: task fit, Trust Score, Audit Score, install safety, permission surface, and a concrete validation plan before this skill touches a workspace.

FailedHigh riskBLOCK Policy
68
Eval report
69
Trust
76
Audit
44
Agent safety

do not auto install

Permission surface: shell or command execution, filesystem or document access

Required gates

Checks an agent must pass before install

Open JSON

Task fit

84

pass

Task wording matches this skill metadata.

  • Evaluate maintaining-dbt-documentation before installing it in an agent workflow
  • security
  • Database and SQL workflows; Claude Code teams; teams that value GitHub adoption signals

Install path

92

pass

Install handoff is available.

  • npx skills add dbt-labs/dbt-agent-skills --skill maintaining-dbt-documentation

Install command safety

92

pass

standard package or runtime install path

  • npx skills add dbt-labs/dbt-agent-skills --skill maintaining-dbt-documentation

Trust score

69

warn

Potentially useful, but at least one trust signal needs human inspection.

  • Manual review
  • 701 GitHub stars
  • Apache-2.0

Audit score

76

warn

Needs review

  • Permission surface may require sandboxing

Agent safety gate

44

warn

Sparse or mixed signals. Useful for discovery, but not for autonomous installation.

  • Test manually in an isolated workspace and compare against safer alternatives.
  • High-risk permission hints: Shell or command execution

License clarity

86

pass

Apache-2.0

  • Apache-2.0

Permission surface

50

fail

shell or command execution, filesystem or document access

  • Shell or command execution: high
  • Network access: medium
  • Filesystem access: medium

Validation plan

What the agent should do next

  1. 1Inspect repository, README/SKILL.md, license, and recent commits before production use.
  2. 2Install in an isolated workspace or sandbox with no production secrets available.
  3. 3Run the smallest representative task and record files touched, commands run, network access, and outputs.
  4. 4Compare the selected skill against at least one alternative when the eval status is review or failed.
  5. 5Promote only after the agent reports a successful verification result and unresolved warnings are accepted.

Do not use when

Conditions that require another skill

  • teams that need a vendor-supported SLA
  • production agents without a repository review
  • The SKILL.md excerpt is truncated, but the provided content is sufficient to assess the skill's purpose and workflow.
  • High-risk permission hints: Shell or command execution
  • Permission surface may require sandboxing
  • The audit_coverage.py script is also truncated, but its functionality is clearly described in SKILL.md and the docstring.

Supporting checks

Trust signals behind the decision

README/SKILL.md completeness

warn

76

Public metadata needs stronger README/SKILL.md context

Recent maintenance

pass

88

2mo since push

Alternatives available

pass

82

Alternative skills are available for comparison.