AI Agent Skill Repository
Browse reusable skills for Codex, Claude Code, Cursor, finance, research, web scraping, PPT, football analytics, data, marketing, design, and more.
Live registry search
Exact name and slug matches are checked against the live registry before ranked alternatives.
Decision filters
Showing 1-16 of 172 ranked candidates matching "web-crawler"
Best blend of relevance, quality, freshness, and verified outcomes
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
$ npx skills add bda-research/node-crawlerScenario Research agents · I need my agent to research a topic, compare sources, and produce a concise report.
CLI + Codex · 4 targets
List of libraries, tools and APIs for web scraping and data processing.
$ npx skills add lorien/awesome-web-scrapingScenario Coding agents · I need a coding agent that can understand a repository, edit code, and review pull requests.
CLI + Codex · 4 targets
Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀
$ npx skills add hect0x7/JMComic-Crawler-PythonScenario GitHub automation · I need my agent to triage GitHub issues, review pull requests, and summarize repository changes.
CLI + Codex · 4 targets
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
$ npx skills add alirezamika/autoscraperScenario GitHub automation · I need my agent to triage GitHub issues, review pull requests, and summarize repository changes.
CLI + Codex · 4 targets
Python scraper based on AI
$ npx skills add ScrapeGraphAI/Scrapegraph-aiScenario Document processing · I need my agent to read PDFs, extract tables, and turn documents into structured data.
CLI + Codex · 4 targets
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
$ npx skills add NaiboWang/EasySpiderScenario Coding agents · I need a coding agent that can understand a repository, edit code, and review pull requests.
CLI + Codex · 4 targets
Scrapy, a fast high-level web crawling & scraping framework for Python.
$ npx skills add scrapy/scrapyScenario GitHub automation · I need my agent to triage GitHub issues, review pull requests, and summarize repository changes.
CLI + Codex · 4 targets
Web crawling built for AI
$ npx skills add unclecode/crawl4aiScenario Research agents · I need my agent to research a topic, compare sources, and produce a concise report.
Claude Code + OpenAI Agents · 4 targets
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
$ npx skills add adbar/trafilaturaScenario Document processing · I need my agent to read PDFs, extract tables, and turn documents into structured data.
CLI + Codex · 4 targets
A next-generation crawling and spidering framework.
$ npx skills add projectdiscovery/katanaScenario GitHub automation · I need my agent to triage GitHub issues, review pull requests, and summarize repository changes.
CLI + Codex · 4 targets
Lighter web automation with Python
$ npx skills add mherrmann/heliumScenario Testing and QA · I need my agent to test a web app, reproduce bugs, and verify fixes.
Browser agents + CLI · 4 targets
Use Playwright to interact with and test local web applications, capture screenshots, debug UI behavior, and inspect browser logs.
$ npx skills add anthropics/skills --skill webapp-testingScenario Testing and QA · I need my agent to test a web app, reproduce bugs, and verify fixes.
Claude Code + OpenAI Agents · 4 targets
小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 知乎问答文章 | 评论爬虫。支持多平台社交媒体内容抓取，提供完整的数据采集解决方案。
$ npx skills add NanmiCoder/MediaCrawlerScenario Coding agents · I need a coding agent that can understand a repository, edit code, and review pull requests.
CLI + Codex · 4 targets
Adaptive web scraping for agent data collection
$ npx skills add D4Vinci/ScraplingScenario Testing and QA · I need my agent to test a web app, reproduce bugs, and verify fixes.
Browser agents + CLI · 4 targets
Web data for AI applications
$ npx skills add firecrawl/firecrawlScenario Document processing · I need my agent to read PDFs, extract tables, and turn documents into structured data.
Claude Code + OpenAI Agents · 4 targets
Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, a…
$ npx skills add dgtlmoon/changedetection.ioScenario Content automation · I need my agent to turn research and product updates into useful content drafts.
CLI + Codex · 4 targets
Page 1
Showing the strongest 16 results to keep the registry fast for humans and agents. Refine by use case, platform, stars, or search query for a narrower shortlist.
Try the agent resolve APIAI Agent Skill Repository
Browse reusable skills for Codex, Claude Code, Cursor, finance, research, web scraping, PPT, football analytics, data, marketing, design, and more.
Live registry search
Exact name and slug matches are checked against the live registry before ranked alternatives.
Decision filters
Showing 1-16 of 172 ranked candidates matching "web-crawler"
Best blend of relevance, quality, freshness, and verified outcomes
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
$ npx skills add bda-research/node-crawlerScenario Research agents · I need my agent to research a topic, compare sources, and produce a concise report.
CLI + Codex · 4 targets
List of libraries, tools and APIs for web scraping and data processing.
$ npx skills add lorien/awesome-web-scrapingScenario Coding agents · I need a coding agent that can understand a repository, edit code, and review pull requests.
CLI + Codex · 4 targets
Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀
$ npx skills add hect0x7/JMComic-Crawler-PythonScenario GitHub automation · I need my agent to triage GitHub issues, review pull requests, and summarize repository changes.
CLI + Codex · 4 targets
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
$ npx skills add alirezamika/autoscraperScenario GitHub automation · I need my agent to triage GitHub issues, review pull requests, and summarize repository changes.
CLI + Codex · 4 targets
Python scraper based on AI
$ npx skills add ScrapeGraphAI/Scrapegraph-aiScenario Document processing · I need my agent to read PDFs, extract tables, and turn documents into structured data.
CLI + Codex · 4 targets
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
$ npx skills add NaiboWang/EasySpiderScenario Coding agents · I need a coding agent that can understand a repository, edit code, and review pull requests.
CLI + Codex · 4 targets
Scrapy, a fast high-level web crawling & scraping framework for Python.
$ npx skills add scrapy/scrapyScenario GitHub automation · I need my agent to triage GitHub issues, review pull requests, and summarize repository changes.
CLI + Codex · 4 targets
Web crawling built for AI
$ npx skills add unclecode/crawl4aiScenario Research agents · I need my agent to research a topic, compare sources, and produce a concise report.
Claude Code + OpenAI Agents · 4 targets
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
$ npx skills add adbar/trafilaturaScenario Document processing · I need my agent to read PDFs, extract tables, and turn documents into structured data.
CLI + Codex · 4 targets
A next-generation crawling and spidering framework.
$ npx skills add projectdiscovery/katanaScenario GitHub automation · I need my agent to triage GitHub issues, review pull requests, and summarize repository changes.
CLI + Codex · 4 targets
Lighter web automation with Python
$ npx skills add mherrmann/heliumScenario Testing and QA · I need my agent to test a web app, reproduce bugs, and verify fixes.
Browser agents + CLI · 4 targets
Use Playwright to interact with and test local web applications, capture screenshots, debug UI behavior, and inspect browser logs.
$ npx skills add anthropics/skills --skill webapp-testingScenario Testing and QA · I need my agent to test a web app, reproduce bugs, and verify fixes.
Claude Code + OpenAI Agents · 4 targets
小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 知乎问答文章 | 评论爬虫。支持多平台社交媒体内容抓取，提供完整的数据采集解决方案。
$ npx skills add NanmiCoder/MediaCrawlerScenario Coding agents · I need a coding agent that can understand a repository, edit code, and review pull requests.
CLI + Codex · 4 targets
Adaptive web scraping for agent data collection
$ npx skills add D4Vinci/ScraplingScenario Testing and QA · I need my agent to test a web app, reproduce bugs, and verify fixes.
Browser agents + CLI · 4 targets
Web data for AI applications
$ npx skills add firecrawl/firecrawlScenario Document processing · I need my agent to read PDFs, extract tables, and turn documents into structured data.
Claude Code + OpenAI Agents · 4 targets
Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, a…
$ npx skills add dgtlmoon/changedetection.ioScenario Content automation · I need my agent to turn research and product updates into useful content drafts.
CLI + Codex · 4 targets
Page 1
Showing the strongest 16 results to keep the registry fast for humans and agents. Refine by use case, platform, stars, or search query for a narrower shortlist.
Try the agent resolve API