Skill audit report
Validates dataset formatting and quality for SageMaker model fine-tuning (SFT, DPO, or RLVR). Use when the user says "is my dataset okay", "evaluate my data", "check my training data", "I have my own data", or before starting any fine-tuning job. Detects file format, checks schema compliance against the selected model and technique, and reports whether the data is ready for training or evaluation.
OpenAgentSkill Trust Score
The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.
GitHub adoption
INFO76
888 GitHub stars
Stars/forks activity
INFO71
888 stars, 152 forks; issue activity unavailable in current metadata
Recent maintenance
PASS100
4d since push
License clarity
PASS86
Apache-2.0
README/SKILL.md completeness
INFO76
Public metadata needs stronger README/SKILL.md context
Dependency/runtime risk
INFO72
command execution surface
Install availability
PASS92
npx skills add awslabs/agent-plugins --skill dataset-evaluation
Install command safety
PASS92
standard package or runtime install path
Permission surface
WARN50
shell or command execution, filesystem or document access
Repository evidence
PASS86
https://github.com/awslabs/agent-plugins/tree/main/plugins/sagemaker-ai/skills/dataset-evaluation
Review status
PASS88
AI review data available
Agent Proven outcomes
INFO54
No agent outcome data yet
Checks
Install path
92
npx skills add awslabs/agent-plugins --skill dataset-evaluation
Repository
88
https://github.com/awslabs/agent-plugins/tree/main/plugins/sagemaker-ai/skills/dataset-evaluation
License
86
Apache-2.0
Maintenance
100
4d since push
AI review
88
Approved with no listed issues
README/SKILL.md completeness
84
Usable description available
Dependency risk
72
command execution surface
Install command safety
92
standard package or runtime install path
Permission surface
50
shell or command execution, filesystem or document access
Stars/forks activity
71
888 stars, 152 forks; issue activity unavailable in current metadata
Adoption
88
888 GitHub stars
Warnings
Method
This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.
Compare nearby options
Wazuh - The Open Source Security Platform. Unified XDR and SIEM protection for endpoints and cloud workloads.
16K Stars · Audit report
🕵️♂️ Collect a dossier on a person by username from 3000+ sites
33K Stars · Audit report
Nuclei is a fast, customizable vulnerability scanner powered by the global security community and built on a simple YAML-based DSL, enabling collaboration to tackle trending vulnerabilities on the internet. It helps you find vulnerabilities in your applications, APIs, networks, DNS, and cloud configurations.
29K Stars · Audit report