AI Agent Skill Repository

AI Agent Skills Directory

Browse reusable skills for Codex, Claude Code, Cursor, finance, research, web scraping, PPT, football analytics, data, marketing, design, and more.

Live registry search

Results for “scrapy-crawler

Exact name and slug matches are checked against the live registry before ranked alternatives.

Clear search

Decision filters

Choose by scenario, quality, and trust signals.

Showing 1-16 of 209 ranked candidates matching "scrapy-crawler"

Best blend of relevance, quality, freshness, and verified outcomes

1

Scrapy Redis

VERIFIEDEXCELLENT · 93TRUST · 86SAFE · REVIEWEDCODING

Redis-based components for Scrapy.

$ npx skills add rmax/scrapy-redis
5.6K stars61 quality86 trustReviewed3mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by rmaxDetailsQuick view
2

Node Crawler

VERIFIEDEXCELLENT · 98TRUST · 87SAFE · REVIEWEDRESEARCH

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

$ npx skills add bda-research/node-crawler
6.8K stars66 quality87 trustReviewed2mo since pushSafe to try

Scenario Research agents

CLI + Codex · 4 targets

typescriptcrawler
by bda-researchDetailsQuick view
3

Crawler Illegal Cases In China

VERIFIEDEXCELLENT · 87TRUST · 83SAFE · REVIEWEDCODING

Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律,避免触碰数据合规红线。

$ npx skills add hiddendevj/Crawler_Illegal_Cases_In_China
4.6K stars60 quality83 trustReviewed5mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

htmlcrawler
by hiddendevjDetailsQuick view
4

Awesome Crawler

VERIFIEDSTRONG · 73TRUST · 79SAFE · REVIEWEDCODING

A collection of awesome web crawler,spider in different languages

$ npx skills add BruceDone/awesome-crawler
7.2K stars54 quality79 trustReviewed with permission notes2y since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

crawler
by BruceDoneDetailsQuick view
5

AutoCrawler

VERIFIEDPROMISING · 67TRUST · 76SAFE · EXPERIMENTALDESIGN

Google, Naver multiprocess image web crawler (Selenium)

$ npx skills add YoongiKim/AutoCrawler
1.7K stars49 quality76 trustExperimentalBrowser agents2y since pushNeeds review

Scenario Multimodal media

Browser agents + CLI · 4 targets

pythoncrawler
by YoongiKimDetailsQuick view
6

Scrapyrt

STRONG · 71TRUST · 76SAFE · REVIEWEDCODING

HTTP API for Scrapy spiders

$ npx skills add scrapinghub/scrapyrt
880 stars47 quality76 trustReviewed with permission notes5mo since pushNeeds review

Scenario Coding agents

CLI + Codex · 4 targets

pythoncrawler
by scrapinghubDetailsQuick view
7

Icrawler

PROMISING · 63TRUST · 74SAFE · REVIEWEDCODING

A multi-thread crawler framework with many builtin image crawlers provided.

$ npx skills add hellock/icrawler
930 stars43 quality74 trustReviewed with permission notes9mo since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by hellockDetailsQuick view
8

Stormcrawler

STRONG · 75TRUST · 79SAFE · REVIEWEDCODING

A scalable, mature and versatile web crawler based on Apache Storm

$ npx skills add apache/stormcrawler
981 stars52 quality79 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

javacrawler
by apacheDetailsQuick view
9

Crawler

STRONG · 70TRUST · 75SAFE · REVIEWEDCODING

A high performance web crawler / scraper in Elixir.

$ npx skills add fredwu/crawler
958 stars52 quality75 trustReviewed with permission notes2mo since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

elixircrawler
by fredwuDetailsQuick view
10

Xxl Crawler

STRONG · 74TRUST · 79SAFE · REVIEWEDCODING

A lightweight web crawler framework.(Java爬虫框架)

$ npx skills add xuxueli/xxl-crawler
756 stars51 quality79 trustReviewed with permission notes2mo since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

javacrawler
by xuxueliDetailsQuick view
11

Crawlab

VERIFIEDEXCELLENT · 90TRUST · 86SAFE · REVIEWEDWORLD CUP

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架

$ npx skills add crawlab-team/crawlab
12.2K stars61 quality86 trustReviewed6mo since pushSafe to try

Scenario Sports analytics

CLI + Codex · 4 targets

gocrawler
by crawlab-teamDetailsQuick view
12

JMComic Crawler Python

VERIFIEDEXCELLENT · 98TRUST · 88SAFE · REVIEWEDCODING

Python API for JMComic | 提供Python API访问禁漫天堂,同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀

$ npx skills add hect0x7/JMComic-Crawler-Python
6.5K stars65 quality88 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by hect0x7DetailsQuick view
13

Weibo Crawler

VERIFIEDEXCELLENT · 87TRUST · 81SAFE · REVIEWEDCODING

新浪微博爬虫,用python爬取新浪微博数据,并下载微博图片和微博视频

$ npx skills add dataabc/weibo-crawler
4.5K stars60 quality81 trustReviewed with permission notes3mo since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by dataabcDetailsQuick view
14

Work Crawler

VERIFIEDEXCELLENT · 93TRUST · 83SAFE · REVIEWEDCODING

Download comics novels 小说漫画下载工具 小説漫画のダウンローダ 小說漫畫下載:腾讯漫画 大角虫漫画 有妖气 咪咕 SF漫画 哦漫画 看漫画 漫画柜 汗汗酷漫 動漫伊甸園 快看漫画 微博动漫 733动漫网 大古漫画网 漫画DB 無限動漫 動漫狂 卡推漫画 动漫之家 动漫屋 古风漫画网 36漫画网 亲亲漫画网 乙女漫…

$ npx skills add kanasimi/work_crawler
4.1K stars60 quality83 trustReviewed5mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

javascriptcrawler
by kanasimiDetailsQuick view
15

Crawler Detect

VERIFIEDEXCELLENT · 93TRUST · 88SAFE · REVIEWEDCODING

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

$ npx skills add JayBizzle/Crawler-Detect
2.4K stars62 quality88 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

phpcrawler
by JayBizzleDetailsQuick view
16

Fscrawler

VERIFIEDEXCELLENT · 91TRUST · 85SAFE · REVIEWEDCODING

Elasticsearch File System Crawler (FS Crawler)

$ npx skills add dadoonet/fscrawler
1.4K stars61 quality85 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

javacrawler
by dadoonetDetailsQuick view

Page 1

Showing the strongest 16 results to keep the registry fast for humans and agents. Refine by use case, platform, stars, or search query for a narrower shortlist.

Try the agent resolve API