Skill 审计报告

agent-observability-eval-pipeline 审计报告.

End-to-end Agent Observability pipeline for an instrumented ml_app — classify production traces, root-cause failures, bootstrap evaluators, then (optionally) sample + publish a dataset, generate + run an experiment, and analyze results. Six narrated phases with a standardized banner and a "continue" checkpoint between each. Pure orchestration over the agent-observability sub-skills (`agent-observability-session-classify`, `agent-observability-trace-rca`, `agent-observability-eval-bootstrap`, `agent-observability-experiment-bootstrap`, `agent-observability-experiment-analyzer`). Use when user says "run the eval pipeline", "go from traces to evals", "bootstrap evals end to end", "classify then RCA then bootstrap", "build an eval set from scratch", "onboard me to datasets and experiments", "walk me through experiments", "I have an ml_app, now what", "Agent Observability onboarding", "guided experiment setup", "from traces to experiments", or wants a deterministic, narrated tour from produ

已阻止 · 阻止需审查生成于 2026年10月13日启发式元数据审计
71
审计
63
信任
66
质量
67
安全性
88
维护
92
安装

OpenAgentSkill 信任评分

63
人工审查

OpenAgentSkill 信任评分

Trust Score 帮助 Agent 在安装前判断一个 Skill 是否足以进入候选清单。

GitHub 采用度

信息

62

158 个 GitHub Stars

Star/Fork 活跃度

警告

57

158 个 Star,25 个 Fork; 当前元数据中没有议题活跃度信息

近期维护

通过

88

距上次推送 2 个月

许可证清晰度

通过

86

MIT

README/SKILL.md 完整度

通过

86

元数据包含足够的用法与工作流上下文

依赖与运行时风险

警告

46

command execution surface, credential or environment access

安装可用性

通过

92

npx skills add datadog-labs/agent-skills --skill agent-observability-eval-pipeline

安装命令安全性

信息

68

dynamic command execution, standard package or runtime install path

权限范围

失败

22

secrets or environment access, shell or command execution

仓库证据

通过

86

https://github.com/datadog-labs/agent-skills/tree/main/agent-observability/agent-observability-eval-pipeline

审查状态

信息

66

可用 AI 审查数据

Agent 验证结果

信息

54

暂未有 Agent 结果数据

检查项

安装与采用审查

5 通过 · 14 需审查

安装路径

92

通过

npx skills add datadog-labs/agent-skills --skill agent-observability-eval-pipeline

仓库

88

通过

https://github.com/datadog-labs/agent-skills/tree/main/agent-observability/agent-observability-eval-pipeline

许可证

86

通过

MIT

维护

88

通过

距上次推送 2 个月

AI 审查

55

检查

The skill invokes sub-skills (agent-observability-session-classify, etc.) that are not included in this repository; they must be separately installed for the pipeline to work.

README/SKILL.md 完整度

86

通过

Usable description available

依赖风险

46

修复

command execution surface, credential or environment access

安装命令安全性

68

检查

dynamic command execution, standard package or runtime install path

权限范围

22

修复

secrets or environment access, shell or command execution

Star/Fork 活跃度

57

修复

158 个 Star,25 个 Fork; 当前元数据中没有议题活跃度信息

采用度

68

信息

158 个 GitHub Stars

警告

  • Dependency or permission surface needs review
  • Permission surface may require sandboxing
  • The skill invokes sub-skills (agent-observability-session-classify, etc.) that are not included in this repository; they must be separately installed for the pipeline to work.
  • Phase 5 executes a generated Python script. While this is a core feature, ensure that any user-supplied data (e.g., dataset content) cannot inject unintended code or commands into the generated script.
  • Quality score needs review
  • Permission surface needs review: secrets or environment access, shell or command execution
  • Stars/forks activity: 158 stars, 25 forks; issue activity unavailable in current metadata
  • Dependency/runtime risk: command execution surface, credential or environment access
  • Permission surface: secrets or environment access, shell or command execution

方法

本报告综合公开元数据、AI 审查输出、仓库活跃度、安装就绪度、OpenAgentSkill 事件、质量评分、信任检查和 Agent 安全门槛;它不是完整的源代码安全审计。

对比相近选项

下一步可审计的相关 Skill