#1
A scalable, mature and versatile web crawler based on Apache Storm
980 starsJun 14, 2026 pushweb-automationJavaCrawler
$ npx skills add apache/stormcrawlerAlternatives
Xxl Crawler alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Xxl Crawler
A lightweight web crawler framework.（Java爬虫框架）
86
Quality
86
Trust
756
Stars
#2
A scalable web crawler framework for Java.
12K starsDec 20, 2025 pushweb-automationJavaCrawler
$ npx skills add code4craft/webmagic#3
Elasticsearch File System Crawler (FS Crawler)
1.4K starsJun 12, 2026 pushweb-automationJavaCrawler
$ npx skills add dadoonet/fscrawler#4
Elegant Scraper and Crawler Framework for Golang
25K starsMay 25, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/colly#5
Easy to use lightweight web crawler（易用的轻量化网络爬虫）
2.5K starsJan 23, 2026 pushweb-automationJavaCrawler
$ npx skills add xtuhcy/gecco#6
Python ProxyPool for web spider
23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool#7
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
6.8K starsJun 4, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add bda-research/node-crawler#8
Redis-based components for Scrapy.
5.6K starsMay 19, 2026 pushweb-automationPythonCrawler
$ npx skills add rmax/scrapy-redis#9
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
4.1K starsApr 3, 2026 pushweb-automationC#Crawler
$ npx skills add dotnetcore/DotnetSpider#10
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
2.4K starsJun 11, 2026 pushweb-automationPHPCrawler
$ npx skills add JayBizzle/Crawler-Detect#11
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
3.7K starsJun 1, 2026 pushweb-automationPythonCrawler
$ npx skills add Boris-code/feapder#12
Every web site provides APIs.
3.6K starsJun 4, 2026 pushweb-automationPythonCrawler
$ npx skills add elliotgao2/toapi#13
Java API For Chrome and Firefox
806 starsMay 20, 2026 pushweb-automationJavaCrawler
$ npx skills add fanyong920/jvppeteer#14
:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
2.7K starsJun 10, 2026 pushweb-automationPHPCrawler
$ npx skills add jae-jae/QueryList#15
Web crawling framework based on asyncio.
2.0K starsJun 4, 2026 pushweb-automationPythonCrawler
$ npx skills add elliotgao2/gain#16
Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性，基于 Workerman。
1.3K starsMay 26, 2026 pushweb-automationPHPCrawler
$ npx skills add kiddyuchina/BeanbunHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Xxl Crawler if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.