#1
:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
2.7K starsJun 10, 2026 pushweb-automationPHPCrawler
$ npx skills add jae-jae/QueryListAlternatives
Crawler Detect alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Crawler Detect
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
100
Quality
96
Trust
2.4K
Stars
#2
https://spatie.be/docs/crawler
2.8K starsJun 12, 2026 pushweb-automationPHPCrawler
$ npx skills add spatie/crawler#3
Elegant Scraper and Crawler Framework for Golang
25K starsMay 25, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/colly#4
Python ProxyPool for web spider
23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool#5
A next-generation crawling and spidering framework.
17K starsJun 15, 2026 pushweb-automationGoCrawler
$ npx skills add projectdiscovery/katana#6
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
6.8K starsJun 4, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add bda-research/node-crawler#7
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
3.7K starsJun 1, 2026 pushweb-automationPythonCrawler
$ npx skills add Boris-code/feapder#8
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
15K starsMay 13, 2026 pushweb-automationPythonCrawler
$ npx skills add codelucas/newspaper#9
Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀
6.0K starsJun 11, 2026 pushweb-automationPythonCrawler
$ npx skills add hect0x7/JMComic-Crawler-Python#10
Redis-based components for Scrapy.
5.6K starsMay 19, 2026 pushweb-automationPythonCrawler
$ npx skills add rmax/scrapy-redis#11
为所有人准备的AI搞钱团队，帮你把经验和方法跑成一门生意。
8.2K starsJun 5, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add TeamWiseFlow/wiseflow#12
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
3.4K starsMay 27, 2026 pushweb-automationGoCrawler
$ npx skills add edoardottt/cariddi#13
Every web site provides APIs.
3.6K starsJun 4, 2026 pushweb-automationPythonCrawler
$ npx skills add elliotgao2/toapi#14
Python脚本。模拟登录知乎， 爬虫，操作excel，微信公众号，远程开机
11K starsMay 9, 2026 pushweb-automationPythonCrawler
$ npx skills add injetlee/Python#15
Node.js scraper to get data from Google Play
2.9K starsMay 31, 2026 pushweb-automationJavaScriptCrawler
$ npx skills add facundoolano/google-play-scraper#16
Scrapy, a fast high-level web crawling & scraping framework for Python.
62K starsJun 11, 2026 pushweb-automationPythonWeb Automation
$ npx skills add scrapy/scrapyHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Crawler Detect if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.