Skill audit report

add-llm-evals Audit report.

Use this when adding evaluation to an LLM/agent app - measuring output quality (correctness, faithfulness, relevance, safety) rather than just watching traces. Trigger on "add evals", "test my prompt", "is my RAG accurate", "catch regressions", "score outputs", or setting up an eval suite in CI. Covers offline (CI) and online (production LLM-as-a-judge) evaluation.

REVIEWED · REVIEWNeeds reviewGenerated Oct 13, 2026Heuristic metadata audit
74
Audit
76
Trust
54
Quality
80
Security
88
Maintain
92
Install

OpenAgentSkill Trust Score

76
Strong shortlist

OpenAgentSkill Trust Score

The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.

GitHub adoption

WARN

48

33 GitHub stars

Stars/forks activity

WARN

48

33 stars, 18 forks; issue activity unavailable in current metadata

Recent maintenance

PASS

88

1mo since push

License clarity

PASS

86

CC0-1.0

README/SKILL.md completeness

PASS

86

Metadata includes enough usage and workflow context

Dependency/runtime risk

PASS

90

no major dependency risk hints in public metadata

Install availability

PASS

92

npx skills add ContextJet-ai/awesome-llm-observability --skill add-llm-evals

Install command safety

PASS

92

standard package or runtime install path

Permission surface

PASS

86

filesystem or document access

Repository evidence

PASS

86

https://github.com/ContextJet-ai/awesome-llm-observability/tree/main/skills/add-llm-evals

Review status

WARN

46

AI review approval is missing

Agent Proven outcomes

INFO

54

No agent outcome data yet

Checks

Install and adoption review

8 Passed · 9 Needs review

Install path

92

PASS

npx skills add ContextJet-ai/awesome-llm-observability --skill add-llm-evals

Repository

88

PASS

https://github.com/ContextJet-ai/awesome-llm-observability/tree/main/skills/add-llm-evals

License

86

PASS

CC0-1.0

Maintenance

88

PASS

1mo since push

AI review

55

CHECK

Review approval is missing

README/SKILL.md completeness

86

PASS

Usable description available

Dependency risk

90

PASS

no major dependency risk hints in public metadata

Install command safety

92

PASS

standard package or runtime install path

Permission surface

86

PASS

filesystem or document access

Stars/forks activity

48

FIX

33 stars, 18 forks; issue activity unavailable in current metadata

Adoption

42

CHECK

33 GitHub stars

Warnings

  • Low GitHub adoption signal
  • AI review approval is missing
  • Quality score needs review
  • GitHub adoption: 33 GitHub stars
  • Stars/forks activity: 33 stars, 18 forks; issue activity unavailable in current metadata
  • Review status: AI review approval is missing

Method

This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.

Compare nearby options

Related skills to audit next