AI Agent Skill Repository

AI Agent Skills Directory

Browse reusable skills for Codex, Claude Code, Cursor, finance, research, web scraping, PPT, football analytics, data, marketing, design, and more.

Live registry search

Results for “crawler

Exact name and slug matches are checked against the live registry before ranked alternatives.

Clear search

Decision filters

Choose by scenario, quality, and trust signals.

Showing 1-16 of 199 ranked candidates matching "crawler"

Best blend of relevance, quality, freshness, and verified outcomes

1

Crawler

STRONG · 70TRUST · 75SAFE · REVIEWEDCODING

A high performance web crawler / scraper in Elixir.

$ npx skills add fredwu/crawler
958 stars52 quality75 trustReviewed with permission notes2mo since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

elixircrawler
by fredwuDetailsQuick view
2

Node Crawler

VERIFIEDEXCELLENT · 98TRUST · 87SAFE · REVIEWEDRESEARCH

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

$ npx skills add bda-research/node-crawler
6.8K stars66 quality87 trustReviewed2mo since pushSafe to try

Scenario Research agents

CLI + Codex · 4 targets

typescriptcrawler
by bda-researchDetailsQuick view
3

Awesome Crawler

VERIFIEDSTRONG · 73TRUST · 79SAFE · REVIEWEDCODING

A collection of awesome web crawler,spider in different languages

$ npx skills add BruceDone/awesome-crawler
7.2K stars54 quality79 trustReviewed with permission notes2y since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

crawler
by BruceDoneDetailsQuick view
4

AutoCrawler

VERIFIEDPROMISING · 67TRUST · 76SAFE · EXPERIMENTALDESIGN

Google, Naver multiprocess image web crawler (Selenium)

$ npx skills add YoongiKim/AutoCrawler
1.7K stars49 quality76 trustExperimentalBrowser agents2y since pushNeeds review

Scenario Multimodal media

Browser agents + CLI · 4 targets

pythoncrawler
by YoongiKimDetailsQuick view
5

Stormcrawler

STRONG · 75TRUST · 79SAFE · REVIEWEDCODING

A scalable, mature and versatile web crawler based on Apache Storm

$ npx skills add apache/stormcrawler
981 stars52 quality79 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

javacrawler
by apacheDetailsQuick view
6

Xxl Crawler

STRONG · 74TRUST · 79SAFE · REVIEWEDCODING

A lightweight web crawler framework.(Java爬虫框架)

$ npx skills add xuxueli/xxl-crawler
756 stars51 quality79 trustReviewed with permission notes2mo since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

javacrawler
by xuxueliDetailsQuick view
7

Fscrawler

VERIFIEDEXCELLENT · 91TRUST · 85SAFE · REVIEWEDCODING

Elasticsearch File System Crawler (FS Crawler)

$ npx skills add dadoonet/fscrawler
1.4K stars61 quality85 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

javacrawler
by dadoonetDetailsQuick view
8

Browsertrix Crawler

VERIFIEDEXCELLENT · 96TRUST · 86SAFE · REVIEWEDCODING

Run a high-fidelity browser-based web archiving crawler in a single Docker container

$ npx skills add webrecorder/browsertrix-crawler
1.1K stars63 quality86 trustReviewedBrowser agents29d since pushSafe to try

Scenario GitHub automation

Browser agents + CLI · 4 targets

typescriptcrawler
by webrecorderDetailsQuick view
9

Siteone Crawler

STRONG · 70TRUST · 79SAFE · REVIEWEDCODING

SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineer…

$ npx skills add janreges/siteone-crawler
770 stars47 quality79 trustReviewed with permission notes5mo since pushNeeds review

Scenario Coding agents

CLI + Codex · 4 targets

rustcrawler
by janregesDetailsQuick view
10

Icrawler

PROMISING · 63TRUST · 74SAFE · REVIEWEDCODING

A multi-thread crawler framework with many builtin image crawlers provided.

$ npx skills add hellock/icrawler
930 stars43 quality74 trustReviewed with permission notes9mo since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by hellockDetailsQuick view
11

Zhihu Crawler

NEEDS REVIEW · 45TRUST · 66SAFE · BLOCKEDCODING

zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目

$ npx skills add wycm/zhihu-crawler
920 stars39 quality66 trustBlocked for auto-install7y since pushRisky

Scenario GitHub automation

CLI + Codex · 4 targets

javacrawler
by wycmDetailsQuick view
12

Headless Chrome Crawler

VERIFIEDSTRONG · 72TRUST · 77SAFE · EXPERIMENTALCODING

Distributed crawler powered by Headless Chrome

$ npx skills add yujiosaka/headless-chrome-crawler
5.6K stars53 quality77 trustExperimentalBrowser agents3y since pushNeeds review

Scenario Testing and QA

Browser agents + CLI · 4 targets

javascriptpuppeteer
by yujiosakaDetailsQuick view
13

Sentinel Crawler

NEEDS REVIEW · 41TRUST · 70SAFE · EXPERIMENTALCODING

Xenomorph Crawler, a Concise, Declarative and Observable Distributed Crawler(Node / Go / Java / Rust) For Web, RDB, OS, also can act as a Monitor(with Prometheus) or ETL…

$ npx skills add wx-chevalier/sentinel-crawler
124 stars33 quality70 trustExperimental3y since pushNeeds review

Scenario Coding agents

CLI + Codex · 4 targets

javascriptetl
by wx-chevalierDetailsQuick view
14

Weibo Crawler

VERIFIEDEXCELLENT · 87TRUST · 81SAFE · REVIEWEDCODING

新浪微博爬虫,用python爬取新浪微博数据,并下载微博图片和微博视频

$ npx skills add dataabc/weibo-crawler
4.5K stars60 quality81 trustReviewed with permission notes3mo since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by dataabcDetailsQuick view
15

Work Crawler

VERIFIEDEXCELLENT · 93TRUST · 83SAFE · REVIEWEDCODING

Download comics novels 小说漫画下载工具 小説漫画のダウンローダ 小說漫畫下載:腾讯漫画 大角虫漫画 有妖气 咪咕 SF漫画 哦漫画 看漫画 漫画柜 汗汗酷漫 動漫伊甸園 快看漫画 微博动漫 733动漫网 大古漫画网 漫画DB 無限動漫 動漫狂 卡推漫画 动漫之家 动漫屋 古风漫画网 36漫画网 亲亲漫画网 乙女漫…

$ npx skills add kanasimi/work_crawler
4.1K stars60 quality83 trustReviewed5mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

javascriptcrawler
by kanasimiDetailsQuick view
16

Tumblr Crawler

VERIFIEDSTRONG · 73TRUST · 79SAFE · REVIEWEDCODING

Easily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片,视频

$ npx skills add dixudx/tumblr-crawler
1.2K stars52 quality79 trustReviewed with permission notes8mo since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by dixudxDetailsQuick view

Page 1

Showing the strongest 16 results to keep the registry fast for humans and agents. Refine by use case, platform, stars, or search query for a narrower shortlist.

Try the agent resolve API