Codex web data workflows

Best Codex skills for web scraping

Ranked OpenAgentSkill shortlist for Codex users crawling websites, extracting structured data, monitoring pages, and preparing web content for agents.

Codex users building web scraping, monitoring, RAG ingestion, and data extraction workflows. Ranked from the OpenAgentSkill index using quality, trust, freshness, adoption, and install readiness.

best Codex skills for web scrapingCodex

Compare top 4 Filter production candidates Resolve this workflow

Ranked

997K

Stars

Top trust

—

Agent proven

Search intent

Find Codex-ready skills for web scraping, crawling, browser automation, markdown extraction, and structured data collection.

These pages are generated from real registry records. The list below is not a generic article; every row links to a skill profile with install, trust, audit, and risk fields.

Resolve task

Scrape product pages into a structured table

Resolve task

Monitor competitor websites for changes

Resolve task

Convert crawled pages into markdown for RAG

Crawlee

37 fitTrust 88Excellent 100Agent Proven —Audit 91 · Safe to try

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Excellent quality, 24K stars, and a 37 use-case fit score.

Best suited scenario

Crawl target URLs

24K starsJun 24, 2026 pushProduction candidateNeeds first agent runTypeScriptPlaywright

Alternatives Compare Audit

$ npx skills add apify/crawlee

Crawlee Python

36 fitTrust 86Excellent 100Agent Proven —Audit 91 · Safe to try

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

Excellent quality, 9.2K stars, and a 36 use-case fit score.

Best suited scenario

Crawl target URLs

9.2K starsJun 19, 2026 pushProduction candidateNeeds first agent runPythonPlaywright

Alternatives Compare Audit

$ npx skills add apify/crawlee-python

Maxun

31 fitTrust 88Excellent 100Agent Proven —Audit 92 · Safe to try

🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥

Excellent quality, 16K stars, and a 31 use-case fit score.

Best suited scenario

Crawl target URLs

16K starsJul 2, 2026 pushProduction candidateNeeds first agent runTypeScriptBrowser Automation

Alternatives Compare Audit

$ npx skills add getmaxun/maxun

Scrapling

30 fitTrust 85Excellent 100Agent Proven —Audit 90 · Needs review

Adaptive web scraping for agent data collection

Excellent quality, 70K stars, and a 30 use-case fit score.

Best suited scenario

Crawl target URLs

70K starsJul 15, 2026 pushStrong shortlistNeeds first agent runPythonWeb Automation

Alternatives Compare Audit

$ npx skills add D4Vinci/Scrapling

Obscura

25 fitTrust 86Excellent 100Agent Proven —Audit 90 · Safe to try

The headless browser for AI agents and web scraping

Excellent quality, 16K stars, and a 25 use-case fit score.

Best suited scenario

Crawl target URLs

16K starsJun 18, 2026 pushProduction candidateNeeds first agent runRustBrowser Automation

Alternatives Compare Audit

$ npx skills add h4ckf0r0day/obscura

Playwright Browser Skill

23 fitTrust 83Excellent 100Agent Proven —Audit 90 · Safe to try

Automate a real browser from the terminal for navigation, form filling, snapshots, screenshots, extraction, and UI-flow debugging.

Excellent quality, 24K stars, and a 23 use-case fit score.

Best suited scenario

Navigate pages

24K starsJul 14, 2026 pushStrong shortlistNeeds first agent runCodexClaude Code

Alternatives Compare Audit

$ npx skills add openai/skills --skill playwright

Webapp Testing

22 fitTrust 87Excellent 100Agent Proven —Audit 92 · Safe to try

Use Playwright to interact with and test local web applications, capture screenshots, debug UI behavior, and inspect browser logs.

Excellent quality, 166K stars, and a 22 use-case fit score.

Best suited scenario

Navigate pages

166K starsJul 24, 2026 pushProduction candidateNeeds first agent runClaude CodeCodex

Alternatives Compare Audit

$ npx skills add anthropics/skills --skill webapp-testing

Browser Use

22 fitTrust 87Excellent 100Agent Proven —Audit 90 · Safe to try

🌐 Make websites accessible for AI agents. Automate tasks online with ease.

Excellent quality, 99K stars, and a 22 use-case fit score.

Best suited scenario

Crawl target URLs

99K starsJun 13, 2026 pushProduction candidateNeeds first agent runPythonAI Agents

Alternatives Compare Audit

$ npx skills add browser-use/browser-use

Huginn

21 fitTrust 90Excellent 100Agent Proven —Audit 92 · Safe to try

Create agents that monitor and act on your behalf. Your agents are standing by!

Excellent quality, 49K stars, and a 21 use-case fit score.

Best suited scenario

Crawl target URLs

49K starsJun 13, 2026 pushProduction candidateNeeds first agent runRubyAutomation

Alternatives Compare Audit

$ npx skills add huginn/huginn

#10

OpenCLI

21 fitTrust 85Excellent 100Agent Proven —Audit 91 · Safe to try

Make Any Website into CLI & Use your logged-in browser by AI agent.

Excellent quality, 27K stars, and a 21 use-case fit score.

Best suited scenario

Crawl target URLs

27K starsJul 12, 2026 pushStrong shortlistNeeds first agent runJavaScriptAI Agents

Alternatives Compare Audit

$ npx skills add jackwener/OpenCLI

#11

Camoufox

19 fitTrust 85Excellent 100Agent Proven —Audit 90 · Safe to try

🦊 Anti-detect browser

Excellent quality, 9.5K stars, and a 19 use-case fit score.

Best suited scenario

Navigate pages

9.5K starsJun 16, 2026 pushStrong shortlistNeeds first agent runC++Playwright

Alternatives Compare Audit

$ npx skills add daijro/camoufox

#12

Claude Seo

19 fitTrust 88Excellent 100Agent Proven —Audit 92 · Safe to try

Universal SEO skill for Claude Code. 25 sub-skills + 18 sub-agents covering technical SEO, E-E-A-T, schema, GEO/AEO, backlinks, local SEO, maps intelligence, semantic clustering, e-commerce SEO, international SEO, Google APIs, and PDF/Excel reporting. Optional DataForSEO, Firecrawl, and Banana extensions.

Excellent quality, 8.9K stars, and a 19 use-case fit score.

Best suited scenario

Crawl target URLs

8.9K starsJun 13, 2026 pushProduction candidateNeeds first agent runPythonClaude Code

Alternatives Compare Audit

$ npx skills add AgriciDaniel/claude-seo

#13

Geo Seo Claude

19 fitTrust 88Excellent 100Agent Proven —Audit 92 · Safe to try

GEO-first SEO skill for Claude Code. Comprehensive AI search optimization for any website — citability scoring, AI crawler analysis, brand authority, schema markup, platform-specific optimization, and PDF reports. If you want learn how to sell this to real businesses, check out the skool community

Excellent quality, 8.1K stars, and a 19 use-case fit score.

Best suited scenario

Inspect source files

8.1K starsMay 27, 2026 pushProduction candidateNeeds first agent runPythonClaude Code

Alternatives Compare Audit

$ npx skills add zubair-trabzada/geo-seo-claude

#14

Deep Research

19 fitTrust 88Excellent 100Agent Proven —Audit 90 · Safe to try

An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic.

Excellent quality, 19K stars, and a 19 use-case fit score.

Best suited scenario

Search sources

19K starsApr 11, 2026 pushProduction candidateNeeds first agent runTypeScriptResearch Agent

Alternatives Compare Audit

$ npx skills add dzhng/deep-research

#15

Dashi Ppt Skill

19 fitTrust 86Excellent 100Agent Proven —Audit 92 · Safe to try

AI agent skill for generating browser-editable presentations with multiple visual themes and export to HTML, PDF, and PPTX.

Excellent quality, 4.5K stars, and a 19 use-case fit score.

Best suited scenario

Crawl target URLs

4.5K starsJul 30, 2026 pushProduction candidateNeeds first agent runJavaScriptClaude Code

Alternatives Compare Audit

$ npx skills add chuspeeism/dashi-ppt-skill

#16

Open Design

19 fitTrust 91Excellent 100Agent Proven —Audit 94 · Safe to try

🎨 Local-first, open-source Claude Design alternative. 🖥️ Native desktop app. ⚡ 259+ Skills · ✨ 142+ Design Systems 🖼️ Web · desktop · mobile prototypes · slides · images · videos · HyperFrames 📦 Sandboxed preview · HTML/PDF/PPTX/MP4 export 🤖 Claude Code / OpenClaw / Codex / Cursor / OpenCode / Qwen / Copilot / Hermes / Kimi & 17+ CLIs.

Excellent quality, 83K stars, and a 19 use-case fit score.

Best suited scenario

Inspect source files

83K starsJul 31, 2026 pushProduction candidateNeeds first agent runTypeScriptAI Agents

Alternatives Compare Audit

$ npx skills add nexu-io/open-design

#17

Claude Code Best Practice

18 fitTrust 88Excellent 100Agent Proven —Audit 91 · Safe to try

from vibe coding to agentic engineering - practice makes claude perfect

Excellent quality, 61K stars, and a 18 use-case fit score.

Best suited scenario

Crawl target URLs

61K starsJun 25, 2026 pushProduction candidateNeeds first agent runHTMLAI Agents

Alternatives Compare Audit

$ npx skills add shanraisshan/claude-code-best-practice

#18

PaddleOCR

18 fitTrust 89Excellent 100Agent Proven —Audit 92 · Safe to try

Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.

Excellent quality, 83K stars, and a 18 use-case fit score.

Best suited scenario

Read uploaded files

83K starsJun 16, 2026 pushProduction candidateNeeds first agent runPythonOCR

Alternatives Compare Audit

$ npx skills add PaddlePaddle/PaddleOCR

#19

Guizang Ppt Skill

17 fitTrust 91Excellent 100Agent Proven —Audit 94 · Safe to try

AI-agent Skill for generating polished HTML slide decks: editorial magazine and Swiss layouts, image prompts, social covers, and a WebGL/low-power presentation runtime.

Excellent quality, 23K stars, and a 17 use-case fit score.

Best suited scenario

Crawl target URLs

23K starsJul 22, 2026 pushProduction candidateNeeds first agent runHTMLAI Agents

Alternatives Compare Audit

$ npx skills add op7418/guizang-ppt-skill

#20

Skyvern

17 fitTrust 85Excellent 100Agent Proven —Audit 90 · Needs review

Automate browser workflows with AI agents

Excellent quality, 23K stars, and a 17 use-case fit score.

Best suited scenario

Navigate pages

23K starsJul 19, 2026 pushStrong shortlistNeeds first agent runPythonBrowser

Alternatives Compare Audit

$ npx skills add Skyvern-AI/skyvern

#21

Frontend Slides

17 fitTrust 88Excellent 100Agent Proven —Audit 91 · Safe to try

Create beautiful slides on the web using a coding agent's frontend skills

Excellent quality, 22K stars, and a 17 use-case fit score.

Best suited scenario

Choose the right deck format

22K starsJun 13, 2026 pushProduction candidateNeeds first agent runJavaScriptCoding Agent

Alternatives Compare Audit

$ npx skills add zarazhangrui/frontend-slides

#22

Cua

17 fitTrust 91Excellent 100Agent Proven —Audit 94 · Safe to try

Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full desktops (macOS, Linux, Windows).

Excellent quality, 21K stars, and a 17 use-case fit score.

Best suited scenario

Crawl target URLs

21K starsAug 1, 2026 pushProduction candidateNeeds first agent runHTMLComputer Use

Alternatives Compare Audit

$ npx skills add trycua/cua

#23

Huashu Design

17 fitTrust 90Excellent 100Agent Proven —Audit 93 · Safe to try

Huashu Design · HTML-native design skill for Claude Code · Claude Code 里 HTML 原生的设计 skill · 高保真原型 / 幻灯片 / 动画 + 20 设计哲学 + 5 维评审 + MP4 导出 · Agent-agnostic

Excellent quality, 19K stars, and a 17 use-case fit score.

Best suited scenario

Choose the right deck format

19K starsJun 6, 2026 pushProduction candidateNeeds first agent runHTMLClaude Code

Alternatives Compare Audit

$ npx skills add alchaincyf/huashu-design

#24

Video Use

17 fitTrust 88Excellent 100Agent Proven —Audit 91 · Safe to try

A tool that lets AI agents like Claude Code edit videos by cutting filler words, color grading, adding subtitles, and more, all via natural language commands.

Excellent quality, 17K stars, and a 17 use-case fit score.

Best suited scenario

Inspect source files

17K starsJul 1, 2026 pushProduction candidateNeeds first agent runPythonClaude Code

Alternatives Compare Audit

$ npx skills add browser-use/video-use

#25

Browser Harness

17 fitTrust 88Excellent 100Agent Proven —Audit 92 · Safe to try

Browser Harness | Self-healing harness that enables LLMs to complete any task.

Excellent quality, 16K stars, and a 17 use-case fit score.

Best suited scenario

Navigate pages

16K starsJul 19, 2026 pushProduction candidateNeeds first agent runPythonAI Agents

Alternatives Compare Audit

$ npx skills add browser-use/browser-harness

#26

Web Ui

17 fitTrust 86Excellent 100Agent Proven —Audit 90 · Safe to try

🖥️ Run AI Agent in your browser.

Excellent quality, 16K stars, and a 17 use-case fit score.

Best suited scenario

Navigate pages

16K starsMay 15, 2026 pushProduction candidateNeeds first agent runPythonAI Agents

Alternatives Compare Audit

$ npx skills add browser-use/web-ui

#27

Opendataloader Pdf

17 fitTrust 87Excellent 100Agent Proven —Audit 91 · Safe to try

PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.

Excellent quality, 26K stars, and a 17 use-case fit score.

Best suited scenario

Chunk documents

26K starsJun 22, 2026 pushProduction candidateNeeds first agent runJavaRAG

Alternatives Compare Audit

$ npx skills add opendataloader-project/opendataloader-pdf

#28

Midscene

17 fitTrust 88Excellent 100Agent Proven —Audit 92 · Safe to try

AI-powered, vision-driven UI automation for every platform.

Excellent quality, 14K stars, and a 17 use-case fit score.

Best suited scenario

Navigate pages

14K starsJul 24, 2026 pushProduction candidateNeeds first agent runTypeScriptComputer Use

Alternatives Compare Audit

$ npx skills add web-infra-dev/midscene

#29

GenericAgent

17 fitTrust 86Excellent 100Agent Proven —Audit 91 · Needs review

Self-evolving agent: grows skill tree from 3.3K-line seed, achieving full system control with 6x less token consumption

Excellent quality, 14K stars, and a 17 use-case fit score.

Best suited scenario

Navigate pages

14K starsJul 31, 2026 pushProduction candidateNeeds first agent runPythonAI Agents

Alternatives Compare Audit

$ npx skills add lsdefine/GenericAgent

#30

PyMuPDF

16 fitTrust 89Excellent 100Agent Proven —Audit 92 · Safe to try

PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.

Excellent quality, 10K stars, and a 16 use-case fit score.

Best suited scenario

Read uploaded files

10K starsJun 29, 2026 pushProduction candidateNeeds first agent runPythonPDF

Alternatives Compare Audit

$ npx skills add pymupdf/PyMuPDF

Selection method

How this list is ranked

OpenAgentSkill scores each candidate against the workflow keywords, then balances fit with GitHub stars, quality signals, trust profile, Agent Proven outcome evidence, maintenance freshness, and whether there is a clear install path.

How does OpenAgentSkill rank codex web scraping?

The ranking combines workflow fit, quality score, trust profile, GitHub adoption, maintenance freshness, and whether a clear install path exists.

Should I install the top skill immediately?

No. Treat the list as a shortlist, open the skill detail page, inspect the repository and license, then test the install command in a sandbox workflow.

Can my agent consume this ranking through an API?

Yes. Use /api/skills/search with the related task or /api/agent/rankings?slug=best-codex-web-scraping-skills to fetch ranked skill data.

Best Codex skills for web scraping

Ranked OpenAgentSkill shortlist for Codex users crawling websites, extracting structured data, monitoring pages, and preparing web content for agents.

Codex users building web scraping, monitoring, RAG ingestion, and data extraction workflows. Ranked from the OpenAgentSkill index using quality, trust, freshness, adoption, and install readiness.

best Codex skills for web scrapingCodex

Best Codex skills for web scraping

Ranked OpenAgentSkill shortlist for Codex users crawling websites, extracting structured data, monitoring pages, and preparing web content for agents.

Codex users building web scraping, monitoring, RAG ingestion, and data extraction workflows. Ranked from the OpenAgentSkill index using quality, trust, freshness, adoption, and install readiness.

best Codex skills for web scrapingCodex