Skill-Audit-Bericht

agent-observability-eval-pipeline Audit-Bericht.

End-to-end Agent Observability pipeline for an instrumented ml_app — classify production traces, root-cause failures, bootstrap evaluators, then (optionally) sample + publish a dataset, generate + run an experiment, and analyze results. Six narrated phases with a standardized banner and a "continue" checkpoint between each. Pure orchestration over the agent-observability sub-skills (`agent-observability-session-classify`, `agent-observability-trace-rca`, `agent-observability-eval-bootstrap`, `agent-observability-experiment-bootstrap`, `agent-observability-experiment-analyzer`). Use when user says "run the eval pipeline", "go from traces to evals", "bootstrap evals end to end", "classify then RCA then bootstrap", "build an eval set from scratch", "onboard me to datasets and experiments", "walk me through experiments", "I have an ml_app, now what", "Agent Observability onboarding", "guided experiment setup", "from traces to experiments", or wants a deterministic, narrated tour from produ

Blockiert · BlockierenPrüfung nötigErstellt 14. Okt. 2026Heuristisches Metadaten-Audit
71
Audit
63
Vertrauen
66
Qualität
67
Sicherheit
88
Maintain
92
Installieren

OpenAgentSkill Trust Score

63
Manuelle Prüfung

OpenAgentSkill Trust Score

The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.

GitHub-Akzeptanz

Info

62

158 GitHub-Stars

Star-/Fork-Aktivität

Warnung

57

158 Stars und 25 Forks; Issue-Aktivität ist in den aktuellen Metadaten nicht verfügbar

Aktuelle Wartung

Bestanden

88

2 Monate seit dem letzten Push

Lizenzklarheit

Bestanden

86

MIT

README/SKILL.md-Vollständigkeit

Bestanden

86

Metadaten enthalten ausreichend Nutzungs- und Workflow-Kontext

Abhängigkeits-/Laufzeitrisiko

Warnung

46

command execution surface, credential or environment access

Installationsverfügbarkeit

Bestanden

92

npx skills add datadog-labs/agent-skills --skill agent-observability-eval-pipeline

Sicherheit des Installationsbefehls

Info

68

dynamic command execution, standard package or runtime install path

Berechtigungsumfang

Fehlgeschlagen

22

secrets or environment access, shell or command execution

Repository-Nachweis

Bestanden

86

https://github.com/datadog-labs/agent-skills/tree/main/agent-observability/agent-observability-eval-pipeline

Prüfstatus

Info

66

KI-Prüfdaten verfügbar

Agent-validierte Ergebnisse

Info

54

Noch keine Agent-Ergebnisdaten

Prüfungen

Installations- und Adoptionsprüfung

5 Bestanden · 14 Prüfung nötig

Installationspfad

92

Bestanden

npx skills add datadog-labs/agent-skills --skill agent-observability-eval-pipeline

Repository

88

Bestanden

https://github.com/datadog-labs/agent-skills/tree/main/agent-observability/agent-observability-eval-pipeline

Lizenz

86

Bestanden

MIT

Wartung

88

Bestanden

2 Monate seit dem letzten Push

KI-Prüfung

55

Prüfen

The skill invokes sub-skills (agent-observability-session-classify, etc.) that are not included in this repository; they must be separately installed for the pipeline to work.

README/SKILL.md-Vollständigkeit

86

Bestanden

Usable description available

Abhängigkeitsrisiko

46

Beheben

command execution surface, credential or environment access

Sicherheit des Installationsbefehls

68

Prüfen

dynamic command execution, standard package or runtime install path

Berechtigungsumfang

22

Beheben

secrets or environment access, shell or command execution

Star-/Fork-Aktivität

57

Beheben

158 Stars und 25 Forks; Issue-Aktivität ist in den aktuellen Metadaten nicht verfügbar

Akzeptanz

68

Info

158 GitHub-Stars

Warnungen

  • Dependency or permission surface needs review
  • Permission surface may require sandboxing
  • The skill invokes sub-skills (agent-observability-session-classify, etc.) that are not included in this repository; they must be separately installed for the pipeline to work.
  • Phase 5 executes a generated Python script. While this is a core feature, ensure that any user-supplied data (e.g., dataset content) cannot inject unintended code or commands into the generated script.
  • Quality score needs review
  • Permission surface needs review: secrets or environment access, shell or command execution
  • Stars/forks activity: 158 stars, 25 forks; issue activity unavailable in current metadata
  • Dependency/runtime risk: command execution surface, credential or environment access
  • Permission surface: secrets or environment access, shell or command execution

Methode

This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.

Nahe Optionen vergleichen

Ähnliche Skills als Nächstes prüfen