Skill audit report
agent-observability-eval-pipeline Audit report.
End-to-end Agent Observability pipeline for an instrumented ml_app — classify production traces, root-cause failures, bootstrap evaluators, then (optionally) sample + publish a dataset, generate + run an experiment, and analyze results. Six narrated phases with a standardized banner and a "continue" checkpoint between each. Pure orchestration over the agent-observability sub-skills (`agent-observability-session-classify`, `agent-observability-trace-rca`, `agent-observability-eval-bootstrap`, `agent-observability-experiment-bootstrap`, `agent-observability-experiment-analyzer`). Use when user says "run the eval pipeline", "go from traces to evals", "bootstrap evals end to end", "classify then RCA then bootstrap", "build an eval set from scratch", "onboard me to datasets and experiments", "walk me through experiments", "I have an ml_app, now what", "Agent Observability onboarding", "guided experiment setup", "from traces to experiments", or wants a deterministic, narrated tour from produ
OpenAgentSkill Trust Score
OpenAgentSkill Trust Score
The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.
GitHub adoption
INFO62
158 GitHub stars
Stars/forks activity
WARN57
158 stars, 25 forks; issue activity unavailable in current metadata
Recent maintenance
PASS88
2mo since push
License clarity
PASS86
MIT
README/SKILL.md completeness
PASS86
Metadata includes enough usage and workflow context
Dependency/runtime risk
WARN46
command execution surface, credential or environment access
Install availability
PASS92
npx skills add datadog-labs/agent-skills --skill agent-observability-eval-pipeline
Install command safety
INFO68
dynamic command execution, standard package or runtime install path
Permission surface
FAIL22
secrets or environment access, shell or command execution
Repository evidence
PASS86
https://github.com/datadog-labs/agent-skills/tree/main/agent-observability/agent-observability-eval-pipeline
Review status
INFO66
AI review data available
Agent Proven outcomes
INFO54
No agent outcome data yet
Checks
Install and adoption review
Install path
92
npx skills add datadog-labs/agent-skills --skill agent-observability-eval-pipeline
Repository
88
https://github.com/datadog-labs/agent-skills/tree/main/agent-observability/agent-observability-eval-pipeline
License
86
MIT
Maintenance
88
2mo since push
AI review
55
The skill invokes sub-skills (agent-observability-session-classify, etc.) that are not included in this repository; they must be separately installed for the pipeline to work.
README/SKILL.md completeness
86
Usable description available
Dependency risk
46
command execution surface, credential or environment access
Install command safety
68
dynamic command execution, standard package or runtime install path
Permission surface
22
secrets or environment access, shell or command execution
Stars/forks activity
57
158 stars, 25 forks; issue activity unavailable in current metadata
Adoption
68
158 GitHub stars
Warnings
- Dependency or permission surface needs review
- Permission surface may require sandboxing
- The skill invokes sub-skills (agent-observability-session-classify, etc.) that are not included in this repository; they must be separately installed for the pipeline to work.
- Phase 5 executes a generated Python script. While this is a core feature, ensure that any user-supplied data (e.g., dataset content) cannot inject unintended code or commands into the generated script.
- Quality score needs review
- Permission surface needs review: secrets or environment access, shell or command execution
- Stars/forks activity: 158 stars, 25 forks; issue activity unavailable in current metadata
- Dependency/runtime risk: command execution surface, credential or environment access
- Permission surface: secrets or environment access, shell or command execution
Method
This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.
Compare nearby options
Related skills to audit next
Frontend Design
Guidance for distinctive, intentional UI design, typography, visual direction, and non-template-like product interfaces.
188K Stars · Audit report
Taste Skill: Anti-Slop Frontend
Design and implementation guidance for distinctive landing pages, portfolios, product demos, and purposeful redesigns.
111K Stars · Audit report
Canvas Design
Create original visual art, posters, PNG assets, and PDF documents through a clear design philosophy.
188K Stars · Audit report