Informe de auditoría del skill

agent-observability-eval-pipeline Informe de auditoría.

End-to-end Agent Observability pipeline for an instrumented ml_app — classify production traces, root-cause failures, bootstrap evaluators, then (optionally) sample + publish a dataset, generate + run an experiment, and analyze results. Six narrated phases with a standardized banner and a "continue" checkpoint between each. Pure orchestration over the agent-observability sub-skills (`agent-observability-session-classify`, `agent-observability-trace-rca`, `agent-observability-eval-bootstrap`, `agent-observability-experiment-bootstrap`, `agent-observability-experiment-analyzer`). Use when user says "run the eval pipeline", "go from traces to evals", "bootstrap evals end to end", "classify then RCA then bootstrap", "build an eval set from scratch", "onboard me to datasets and experiments", "walk me through experiments", "I have an ml_app, now what", "Agent Observability onboarding", "guided experiment setup", "from traces to experiments", or wants a deterministic, narrated tour from produ

Bloqueado · BloquearRequiere revisiónGenerado 13 oct 2026Auditoría heurística de metadatos
71
Auditoría
63
Confianza
66
Calidad
67
Seguridad
88
Maintain
92
Instalar

Trust Score de OpenAgentSkill

63
Revisión manual

Trust Score de OpenAgentSkill

The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.

Adopción en GitHub

Info

62

158 estrellas de GitHub

Actividad de stars/forks

Advertencia

57

158 estrellas y 25 forks; la actividad de issues no está disponible en los metadatos actuales

Mantenimiento reciente

Aprobado

88

2 meses desde el último push

Claridad de licencia

Aprobado

86

MIT

Completitud de README/SKILL.md

Aprobado

86

Los metadatos incluyen suficiente contexto de uso y flujo de trabajo

Riesgo de dependencias/runtime

Advertencia

46

command execution surface, credential or environment access

Disponibilidad de instalación

Aprobado

92

npx skills add datadog-labs/agent-skills --skill agent-observability-eval-pipeline

Seguridad del comando de instalación

Info

68

dynamic command execution, standard package or runtime install path

Superficie de permisos

Fallido

22

secrets or environment access, shell or command execution

Evidencia del repositorio

Aprobado

86

https://github.com/datadog-labs/agent-skills/tree/main/agent-observability/agent-observability-eval-pipeline

Estado de revisión

Info

66

Hay datos de revisión por IA disponibles

Resultados comprobados por Agent

Info

54

Aún no hay datos de resultados del Agent

Comprobaciones

Revisión de instalación y adopción

5 Aprobado · 14 Requiere revisión

Ruta de instalación

92

Aprobado

npx skills add datadog-labs/agent-skills --skill agent-observability-eval-pipeline

Repositorio

88

Aprobado

https://github.com/datadog-labs/agent-skills/tree/main/agent-observability/agent-observability-eval-pipeline

Licencia

86

Aprobado

MIT

Mantenimiento

88

Aprobado

2 meses desde el último push

Revisión por IA

55

Revisar

The skill invokes sub-skills (agent-observability-session-classify, etc.) that are not included in this repository; they must be separately installed for the pipeline to work.

Completitud de README/SKILL.md

86

Aprobado

Usable description available

Riesgo de dependencias

46

Corregir

command execution surface, credential or environment access

Seguridad del comando de instalación

68

Revisar

dynamic command execution, standard package or runtime install path

Superficie de permisos

22

Corregir

secrets or environment access, shell or command execution

Actividad de stars/forks

57

Corregir

158 estrellas y 25 forks; la actividad de issues no está disponible en los metadatos actuales

Adopción

68

Info

158 estrellas de GitHub

Advertencias

  • Dependency or permission surface needs review
  • Permission surface may require sandboxing
  • The skill invokes sub-skills (agent-observability-session-classify, etc.) that are not included in this repository; they must be separately installed for the pipeline to work.
  • Phase 5 executes a generated Python script. While this is a core feature, ensure that any user-supplied data (e.g., dataset content) cannot inject unintended code or commands into the generated script.
  • Quality score needs review
  • Permission surface needs review: secrets or environment access, shell or command execution
  • Stars/forks activity: 158 stars, 25 forks; issue activity unavailable in current metadata
  • Dependency/runtime risk: command execution surface, credential or environment access
  • Permission surface: secrets or environment access, shell or command execution

Método

This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.

Comparar opciones cercanas

Skills relacionados para auditar después