Skill rankings

Best web scraping skills for AI agents

Find skills for crawling websites, extracting structured data, monitoring pages, and turning messy web content into agent-ready inputs.

Shown: 23 · Candidates: 471

Compare top 4

01
Crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
@apifyBrowser Automation25,731
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
88/100
Quality
100/100
Freshness
35/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
35/100
02
Crawlee Python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
@apifyBrowser Automation9,507
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
80/100
Quality
100/100
Freshness
34/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
34/100
03
Webapp Testing
Use Playwright to interact with and test local web applications, capture screenshots, debug UI behavior, and inspect browser logs.
@anthropicsBrowser Automation180,766
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
100/100
Quality
100/100
Freshness
93/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
23/100
04
Scrapling
Adaptive web scraping for agent data collection
@D4VinciWeb Automation70,009
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
97/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
87/100
Task fit
26/100
05
Maxun
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
@getmaxunWeb Automation16,203
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
84/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
25/100
06
GenericAgent
Self-evolving agent: grows skill tree from 3.3K-line seed, achieving full system control with 6x less token consumption
@lsdefineAgent Frameworks14,276
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
83/100
Quality
100/100
Freshness
74/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
17/100
07
Playwright Browser Skill
Automate a real browser from the terminal for navigation, form filling, snapshots, screenshots, extraction, and UI-flow debugging.
@openaiBrowser Automation28,031
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
89/100
Quality
100/100
Freshness
31/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
21/100
08
Browser Use
🌐 Make websites accessible for AI agents. Automate tasks online with ease.
@browser-useAgent Frameworks98,702
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
100/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
22/100
09
AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
@any4aiData3,414
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
71/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
25/100
10
Open Design
🎨 Local-first, open-source Claude Design alternative. 🖥️ Native desktop app. ⚡ 259+ Skills · ✨ 142+ Design Systems 🖼️ Web · desktop · mobile prototypes · slides · images · videos · HyperFrames 📦 Sandboxed preview · HTML/PDF/PPTX/MP4 export 🤖 Claude Code / OpenClaw / Codex / Cursor / OpenCode / Qwen / Copilot / Hermes / Kimi & 17+ CLIs.
@nexu-ioAgent Skills88,117
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
99/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
19/100
11
OpenCLI
Make Any Website into CLI & Use your logged-in browser by AI agent.
@jackwenerAgent Frameworks26,604
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
89/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
20/100
12
Claude Code Best Practice
from vibe coding to agentic engineering - practice makes claude perfect
@shanraisshanAgent Frameworks60,686
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
96/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
18/100
13
Guizang Ppt Skill
AI-agent Skill for generating polished HTML slide decks: editorial magazine and Swiss layouts, image prompts, social covers, and a WebGL/low-power presentation runtime.
@op7418Agent Skills24,929
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
88/100
Quality
100/100
Freshness
5/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
18/100
14
Huginn
Create agents that monitor and act on your behalf. Your agents are standing by!
@huginnAutomation49,478
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
94/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
18/100
15
Archify
Any agent Skill: generate beautiful architecture diagrams with dark/light theme toggle and PNG/JPEG/WebP/SVG export
@tt-a1iAgent Skills47,183
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
94/100
Quality
100/100
Freshness
23/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
90/100
Task fit
16/100
16
Browser Harness
Browser Harness | Self-healing harness that enables LLMs to complete any task.
@browser-useAgent Frameworks17,301
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
85/100
Quality
100/100
Freshness
15/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
17/100
17
Frontend Slides
Create beautiful slides on the web using a coding agent's frontend skills
@zarazhangruiCoding28,772
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
89/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
18/100
18
Dashi Ppt Skill
AI agent skill for generating browser-editable presentations with multiple visual themes and export to HTML, PDF, and PPTX.
@chuspeeismPresentations5,222
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
74/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
19/100
19
Cua
Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full desktops (macOS, Linux, Windows).
@trycuaAutomation21,387
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
87/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
17/100
20
Opendataloader Pdf
PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.
@opendataloader-projectData25,752
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
88/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
17/100
21
Video Use
A tool that lets AI agents like Claude Code edit videos by cutting filler words, color grading, adding subtitles, and more, all via natural language commands.
@browser-useMedia17,140
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
85/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
17/100
22
Skyvern
Automate browser workflows with AI agents
@Skyvern-AIWeb Automation22,501
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
87/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
87/100
Task fit
17/100
23
Midscene
AI-powered, vision-driven UI automation for every platform.
@web-infra-devAutomation14,188
Review before use
View details
Ranking signals
Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.
Popularity
83/100
Quality
100/100
Freshness
0/100
Agent evidence
0/100
Evidence confidence
0/100
Install readiness
100/100
Task fit
17/100

A shortlist from up to 480 directory candidates, not the entire registry. Stars belong to repositories. Signals are not safety guarantees or runtime verification.

How this list works

Matches task and source metadata, then considers quality, popularity and freshness. Source descriptions are not execution evidence.

Signals use a 0–100 scale. They explain the shortlist; the ordering follows this list’s method, not any one score.