#1
Elegant Scraper and Crawler Framework for Golang
25K starsMay 25, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/collyAlternatives
Webmagic alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Webmagic
A scalable web crawler framework for Java.
100
Quality
91
Trust
12K
Stars
#2
Elasticsearch File System Crawler (FS Crawler)
1.4K starsJun 12, 2026 pushweb-automationJavaCrawler
$ npx skills add dadoonet/fscrawler#3
Easy to use lightweight web crawler（易用的轻量化网络爬虫）
2.5K starsJan 23, 2026 pushweb-automationJavaCrawler
$ npx skills add xtuhcy/gecco#4
A scalable, mature and versatile web crawler based on Apache Storm
980 starsJun 14, 2026 pushweb-automationJavaCrawler
$ npx skills add apache/stormcrawler#5
A lightweight web crawler framework.（Java爬虫框架）
756 starsJun 13, 2026 pushweb-automationJavaCrawler
$ npx skills add xuxueli/xxl-crawler#6
Java API For Chrome and Firefox
806 starsMay 20, 2026 pushweb-automationJavaCrawler
$ npx skills add fanyong920/jvppeteer#7
Scrapy, a fast high-level web crawling & scraping framework for Python.
62K starsJun 11, 2026 pushweb-automationPythonWeb Automation
$ npx skills add scrapy/scrapy#8
Fess is very powerful and easily deployable Enterprise Search Server.
1.1K starsJun 11, 2026 pushweb-automationJavaCrawler
$ npx skills add codelibs/fess#9
Python ProxyPool for web spider
23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool#10
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
15K starsMay 13, 2026 pushweb-automationPythonCrawler
$ npx skills add codelucas/newspaper#11
A next-generation crawling and spidering framework.
17K starsJun 15, 2026 pushweb-automationGoCrawler
$ npx skills add projectdiscovery/katana#12
Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀
6.0K starsJun 11, 2026 pushweb-automationPythonCrawler
$ npx skills add hect0x7/JMComic-Crawler-Python#13
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
6.8K starsJun 4, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add bda-research/node-crawler#14
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
2.8K starsApr 16, 2025 pushweb-automationGoCrawler
$ npx skills add geziyor/geziyor#15
Redis-based components for Scrapy.
5.6K starsMay 19, 2026 pushweb-automationPythonCrawler
$ npx skills add rmax/scrapy-redis#16
A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
2.8K starsJul 3, 2021 pushweb-automationHTMLCrawler
$ npx skills add NikolaiT/GoogleScraperHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Webmagic if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.