Skip to content
OpenAgentSkill
Browsing is open · Catalog captured 2026-11-21 · Automatic updates and account services are paused.
Browser & automation

Record And Replay Skill

An agent-agnostic skill that records user workflows in browser or desktop and converts them into reusable AI-agent skills for Claude Code, Codex CLI, and opencode.

ugarchance · AI review on file

Installation

Read the source and dependencies before running a command. Copying does not install or execute anything.

npx skills add ugarchance/record-and-replay-skill

About this skill

record-and-replay

Agent-agnostic, open-source record & replay skill. Let the user demonstrate a workflow — in the browser or on the desktop — while an AI coding agent records it, then turns the demonstration into a reusable agent skill.

Inspired by OpenAI Codex's macOS-only Record & Replay plugin, rebuilt on open tooling so it works across platforms and across agents: Claude Code, Codex CLI, opencode, and any agent that can run shell commands and read SKILL.md-style skills.

Platform support

ModemacOSWindowsLinux
Browser recording (Playwright)✅✅✅
Desktop recording (event stream)✅✅✅ (X11)

How it works

Browser mode (default — richest evidence): launches a headed browser via Playwright (your installed Google Chrome if available, bundled Chromium otherwise) and records every user action into events.jsonl — each with multiple selector candidates (testId → role+name → id → text → css) — plus Playwright trace chunks (DOM snapshots + screenshots, 60 s checkpoints).

Desktop mode: a single-process recorder (pynput) captures global mouse/keyboard events, active-window/title changes and a half-resolution JPEG at each click into desktop-events.jsonl + screens/ — the same philosophy as Codex's native Record & Replay (an event/context stream, not video) at ~0-3% CPU. On macOS every click also records the accessibility description of the element under the cursor (AXButton "Save"), so generated skills target semantics rather than pixels.

The agent then reads the recording (compact markdown summaries via the bundled summarizers), treats it as evidence of intent — not a pixel-by-pixel script — and generates a reusable skill with semantic locators and verification steps.

Install

git clone https://github.com/ugarchance/record-and-replay-skill ~/.agents/skills/record-and-replay
cd ~/.agents/skills/record-and-replay
node setup.mjs      # npm install + (n