O

Decision filters

Choose skills by scenario, quality, and trust signals.

4 skills matching "spiders"

Best blend of quality, stars, freshness, and agent usage

1

Crawler Detect

VERIFIEDEXCELLENT · 100

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

$ npx skills add JayBizzle/Crawler-Detect
2.4K stars65 qualityClaude Code
High-confidence pick with strong adoption and healthy maintenance signals.
phpcrawler
by JayBizzleQuick view
2

Crawlab

VERIFIEDEXCELLENT · 100

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

$ npx skills add crawlab-team/crawlab
12.2K stars65 qualityClaude Code
High-confidence pick with strong adoption and healthy maintenance signals.
gocrawler
by crawlab-teamQuick view
3

SpiderSuite

STRONG · 70

SpiderSuite releases, wiki and roadmap

$ npx skills add spidersuite/SpiderSuite
959 stars52 qualityClaude Code
Solid option that is likely worth shortlisting for production workflows.
crawler
by spidersuiteQuick view
4

Scrapyrt

STRONG · 75

HTTP API for Scrapy spiders

$ npx skills add scrapinghub/scrapyrt
881 stars51 qualityClaude Code
Solid option that is likely worth shortlisting for production workflows.
pythoncrawler
by scrapinghubQuick view