Skill audit report
agent-observability-replay-trace Audit report.
Use when a developer wants to iterate on ONE specific Agent Observability / LLM Obs trace whose output they didn't like — re-running that trace against their LOCAL code, seeing a concise diff of the old vs new output, and looping (change code → replay → diff) until satisfied. Invoked as /agent-observability-replay-trace <trace-id> [changes to test]. Signals: "replay this trace"; "iterate on a trace"; "this trace's output is wrong, fix it and re-run"; "re-run trace <id> with <change>"; pasting a trace id from the Agent Observability UI with a description of what to fix. It fetches the trace via the datadog-llmo MCP or the pup CLI, edits code, re-runs the app to emit a NEW trace, and diffs the two — no local server, no browser. For agents traced with ddtrace / LLM Obs (Python first-class), with JSON-serializable entry input. Do NOT use for: scored Experiments or the browser "Replay" button (that's agent-observability-replay-experiment), building an experiment from a dataset/CSV, writing
OpenAgentSkill Trust Score
OpenAgentSkill Trust Score
The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.
GitHub adoption
INFO62
158 GitHub stars
Stars/forks activity
WARN57
158 stars, 25 forks; issue activity unavailable in current metadata
Recent maintenance
PASS88
2mo since push
License clarity
PASS86
MIT
README/SKILL.md completeness
PASS86
Metadata includes enough usage and workflow context
Dependency/runtime risk
WARN46
command execution surface, credential or environment access
Install availability
PASS92
npx skills add datadog-labs/agent-skills --skill agent-observability-replay-trace
Install command safety
PASS92
standard package or runtime install path
Permission surface
FAIL22
secrets or environment access, shell or command execution
Repository evidence
PASS86
https://github.com/datadog-labs/agent-skills/tree/main/agent-observability/agent-observability-replay-trace
Review status
INFO66
AI review data available
Agent Proven outcomes
INFO54
No agent outcome data yet
Checks
Install and adoption review
Install path
92
npx skills add datadog-labs/agent-skills --skill agent-observability-replay-trace
Repository
88
https://github.com/datadog-labs/agent-skills/tree/main/agent-observability/agent-observability-replay-trace
License
86
MIT
Maintenance
88
2mo since push
AI review
55
The provided excerpt is incomplete; full SKILL.md and references were not fully reviewed, but the visible content is consistent and detailed.
README/SKILL.md completeness
86
Usable description available
Dependency risk
46
command execution surface, credential or environment access
Install command safety
92
standard package or runtime install path
Permission surface
22
secrets or environment access, shell or command execution
Stars/forks activity
57
158 stars, 25 forks; issue activity unavailable in current metadata
Adoption
68
158 GitHub stars
Warnings
- Dependency or permission surface needs review
- Permission surface may require sandboxing
- The provided excerpt is incomplete; full SKILL.md and references were not fully reviewed, but the visible content is consistent and detailed.
- The parsed metadata description shows '>-' which appears to be a YAML folding artifact, not a content defect.
- Quality score needs review
- Permission surface needs review: secrets or environment access, shell or command execution
- Stars/forks activity: 158 stars, 25 forks; issue activity unavailable in current metadata
- Dependency/runtime risk: command execution surface, credential or environment access
- Permission surface: secrets or environment access, shell or command execution
Method
This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.
Compare nearby options