Skill audit report

promptfoo-evals Audit report.

Write, refine, run, and QA non-redteam promptfoo eval suites after the target or provider already works: prompts, vars, test cases, assertions, model-graded rubrics, transforms, datasets, output exports, filters, and CI gates. Use for regression tests and eval-suite authoring. Do not use for connecting a new target/provider, mapping HTTP requests or auth, smoke-testing an endpoint, or redteam plugin/strategy setup; use `promptfoo-provider-setup` for connection work instead.

EXPERIMENTAL · REVIEWNeeds reviewGenerated Oct 21, 2026Heuristic metadata audit
83
Audit
77
Trust
88
Quality
76
Security
88
Maintain
92
Install

OpenAgentSkill Trust Score

77
Strong shortlist

OpenAgentSkill Trust Score

The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.

GitHub adoption

PASS

100

25K GitHub stars

Stars/forks activity

PASS

97

25K stars, 2.3K forks; issue activity unavailable in current metadata

Recent maintenance

PASS

88

2mo since push

License clarity

PASS

86

MIT

README/SKILL.md completeness

INFO

76

Public metadata needs stronger README/SKILL.md context

Dependency/runtime risk

WARN

46

command execution surface, credential or environment access

Install availability

PASS

92

npx skills add promptfoo/promptfoo --skill promptfoo-evals

Install command safety

PASS

92

standard package or runtime install path

Permission surface

FAIL

18

secrets or environment access, shell or command execution

Repository evidence

PASS

86

https://github.com/promptfoo/promptfoo/tree/main/.claude/skills/promptfoo-evals

Review status

PASS

88

AI review data available

Agent Proven outcomes

INFO

54

No agent outcome data yet

Checks

Install and adoption review

9 Passed · 8 Needs review

Install path

92

PASS

npx skills add promptfoo/promptfoo --skill promptfoo-evals

Repository

88

PASS

https://github.com/promptfoo/promptfoo/tree/main/.claude/skills/promptfoo-evals

License

86

PASS

MIT

Maintenance

88

PASS

2mo since push

AI review

88

PASS

Approved with no listed issues

README/SKILL.md completeness

84

PASS

Usable description available

Dependency risk

46

FIX

command execution surface, credential or environment access

Install command safety

92

PASS

standard package or runtime install path

Permission surface

18

FIX

secrets or environment access, shell or command execution

Stars/forks activity

97

PASS

25K stars, 2.3K forks; issue activity unavailable in current metadata

Adoption

88

PASS

25K GitHub stars

Warnings

  • Dependency or permission surface needs review
  • Permission surface may require sandboxing
  • Quality score needs review
  • Permission surface needs review: secrets or environment access, shell or command execution
  • Dependency/runtime risk: command execution surface, credential or environment access
  • Permission surface: secrets or environment access, shell or command execution

Method

This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.

Compare nearby options

Related skills to audit next