Record And Replay Skill
An agent-agnostic skill that records user workflows in browser or desktop and converts them into reusable AI-agent skills for Claude Code, Codex CLI, and opencode.
ugarchance · AI review on file
Installation
Read the source and dependencies before running a command. Copying does not install or execute anything.
npx skills add ugarchance/record-and-replay-skillAbout this skill
record-and-replay
Agent-agnostic, open-source record & replay skill. Let the user demonstrate a workflow — in the browser or on the desktop — while an AI coding agent records it, then turns the demonstration into a reusable agent skill.
Inspired by OpenAI Codex's macOS-only Record & Replay plugin, rebuilt on open tooling so it works across platforms and across agents: Claude Code, Codex CLI, opencode, and any agent that can run shell commands and read SKILL.md-style skills.
Platform support
| Mode | macOS | Windows | Linux |
|---|---|---|---|
| Browser recording (Playwright) | ✅ | ✅ | ✅ |
| Desktop recording (event stream) | ✅ | ✅ | ✅ (X11) |
How it works
Browser mode (default — richest evidence): launches a headed browser via Playwright (your installed Google Chrome if available, bundled Chromium otherwise) and records every user action into events.jsonl — each with multiple selector candidates (testId → role+name → id → text → css) — plus Playwright trace chunks (DOM snapshots + screenshots, 60 s checkpoints).
Desktop mode: a single-process recorder (pynput) captures global mouse/keyboard events, active-window/title changes and a half-resolution JPEG at each click into desktop-events.jsonl + screens/ — the same philosophy as Codex's native Record & Replay (an event/context stream, not video) at ~0-3% CPU. On macOS every click also records the accessibility description of the element under the cursor (AXButton "Save"), so generated skills target semantics rather than pixels.
The agent then reads the recording (compact markdown summaries via the bundled summarizers), treats it as evidence of intent — not a pixel-by-pixel script — and generates a reusable skill with semantic locators and verification steps.
Install
git clone https://github.com/ugarchance/record-and-replay-skill ~/.agents/skills/record-and-replay
cd ~/.agents/skills/record-and-replay
node setup.mjs # npm install + (n