#1
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
2.4K starsJun 11, 2026 pushweb-automationPHPCrawler
$ npx skills add JayBizzle/Crawler-DetectAlternatives
Crawler alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Crawler
https://spatie.be/docs/crawler
100
Quality
93
Trust
2.8K
Stars
#2
:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
2.7K starsJun 10, 2026 pushweb-automationPHPCrawler
$ npx skills add jae-jae/QueryList#3
Elegant Scraper and Crawler Framework for Golang
25K starsMay 25, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/colly#4
Python ProxyPool for web spider
23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool#5
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
15K starsMay 13, 2026 pushweb-automationPythonCrawler
$ npx skills add codelucas/newspaper#6
A next-generation crawling and spidering framework.
17K starsJun 15, 2026 pushweb-automationGoCrawler
$ npx skills add projectdiscovery/katana#7
Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀
6.0K starsJun 11, 2026 pushweb-automationPythonCrawler
$ npx skills add hect0x7/JMComic-Crawler-Python#8
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
6.8K starsJun 4, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add bda-research/node-crawler#9
Redis-based components for Scrapy.
5.6K starsMay 19, 2026 pushweb-automationPythonCrawler
$ npx skills add rmax/scrapy-redis#10
为所有人准备的AI搞钱团队，帮你把经验和方法跑成一门生意。
8.2K starsJun 5, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add TeamWiseFlow/wiseflow#11
Python脚本。模拟登录知乎， 爬虫，操作excel，微信公众号，远程开机
11K starsMay 9, 2026 pushweb-automationPythonCrawler
$ npx skills add injetlee/Python#12
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
3.7K starsJun 1, 2026 pushweb-automationPythonCrawler
$ npx skills add Boris-code/feapder#13
Node.js scraper to get data from Google Play
2.9K starsMay 31, 2026 pushweb-automationJavaScriptCrawler
$ npx skills add facundoolano/google-play-scraper#14
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
44K starsMay 22, 2026 pushweb-automationJavaScriptCrawler
$ npx skills add NaiboWang/EasySpider#15
👾 Fast and simple video download library and CLI tool written in Go
31K starsMar 29, 2026 pushweb-automationGoCrawler
$ npx skills add iawia002/lux#16
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
3.4K starsMay 27, 2026 pushweb-automationGoCrawler
$ npx skills add edoardottt/cariddiHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Crawler if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.