Skill audit report
Use this to measure and monitor the quality of a RAG (retrieval-augmented generation) pipeline - whether it retrieves the right context and answers faithfully. Trigger on "my RAG gives wrong answers", "is my retrieval any good", "the chatbot makes things up", "evaluate my RAG", "improve RAG accuracy". Diagnose whether the failure is in retrieval or generation - they need different fixes.
OpenAgentSkill Trust Score
The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.
GitHub adoption
WARN48
33 GitHub stars
Stars/forks activity
WARN48
33 stars, 18 forks; issue activity unavailable in current metadata
Recent maintenance
PASS100
26d since push
License clarity
PASS86
CC0-1.0
README/SKILL.md completeness
PASS86
Metadata includes enough usage and workflow context
Dependency/runtime risk
PASS90
no major dependency risk hints in public metadata
Install availability
PASS92
npx skills add ContextJet-ai/awesome-llm-observability --skill monitor-rag-quality
Install command safety
PASS92
standard package or runtime install path
Permission surface
PASS100
no high-risk permission surface in public metadata
Repository evidence
PASS86
https://github.com/ContextJet-ai/awesome-llm-observability/tree/main/skills/monitor-rag-quality
Review status
WARN46
AI review approval is missing
Agent Proven outcomes
INFO54
No agent outcome data yet
Checks
Install path
92
npx skills add ContextJet-ai/awesome-llm-observability --skill monitor-rag-quality
Repository
88
https://github.com/ContextJet-ai/awesome-llm-observability/tree/main/skills/monitor-rag-quality
License
86
CC0-1.0
Maintenance
100
26d since push
AI review
55
Review approval is missing
README/SKILL.md completeness
86
Usable description available
Dependency risk
90
no major dependency risk hints in public metadata
Install command safety
92
standard package or runtime install path
Permission surface
100
no high-risk permission surface in public metadata
Stars/forks activity
48
33 stars, 18 forks; issue activity unavailable in current metadata
Adoption
42
33 GitHub stars
Warnings
Method
This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.
Compare nearby options