OpenAgentSkill Registry Manifest
Skill: agent-observability-eval-pipeline
Slug: datadog-labs-agent-observability-eval-pipeline
Category: design-creative
Description: End-to-end Agent Observability pipeline for an instrumented ml_app — classify production traces, root-cause failures, bootstrap evaluators, then (optionally) sample + publish a dataset, generate + run an experiment, and analyze results. Six narrated phases with a standardized banner and a "continue" checkpoint between each. Pure orchestration over the agent-observability sub-skills (`agent-observability-session-classify`, `agent-observability-trace-rca`, `agent-observability-eval-bootstrap`, `agent-observability-experiment-bootstrap`, `agent-observability-experiment-analyzer`). Use when user says "run the eval pipeline", "go from traces to evals", "bootstrap evals end to end", "classify then RCA then bootstrap", "build an eval set from scratch", "onboard me to datasets and experiments", "walk me through experiments", "I have an ml_app, now what", "Agent Observability onboarding", "guided experiment setup", "from traces to experiments", or wants a deterministic, narrated tour from produ

Agent fit:
- Decision: 68/100 Prototype first
- Primary fit: Research agents
- Role: Fallback candidate

Supply profile:
- Track: Research and knowledge work
- Scenario: Research agents
- Applicable agents: Claude Code, CLI, Codex, Cursor
- Maintenance: 9d since push
- Risk: Needs review

Trust:
- Trust score: 64/100 Manual review
- Audit: 74/100 Needs review

Attribution:
- Status: Registry indexed
- Source: recursive skill source sync
- Creator: datadog-labs
- Claim URL: https://www.openagentskill.com/skills/datadog-labs-agent-observability-eval-pipeline#claim-this-skill

Install:
npx skills add datadog-labs/agent-skills --skill agent-observability-eval-pipeline

URLs:
- Web: https://www.openagentskill.com/skills/datadog-labs-agent-observability-eval-pipeline
- API: https://www.openagentskill.com/api/agent/skills/datadog-labs-agent-observability-eval-pipeline
- Install API: https://www.openagentskill.com/api/skills/datadog-labs-agent-observability-eval-pipeline/install
- Repository: https://github.com/datadog-labs/agent-skills/tree/main/agent-observability/agent-observability-eval-pipeline