A scalable web crawler framework for Java.
$ npx skills add code4craft/webmagicAlternatives
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Elasticsearch File System Crawler (FS Crawler)
A scalable web crawler framework for Java.
$ npx skills add code4craft/webmagicEasy to use lightweight web crawler(易用的轻量化网络爬虫)
$ npx skills add xtuhcy/geccoFess is very powerful and easily deployable Enterprise Search Server.
$ npx skills add codelibs/fessA scalable, mature and versatile web crawler based on Apache Storm
$ npx skills add apache/stormcrawlerA lightweight web crawler framework.(Java爬虫框架)
$ npx skills add xuxueli/xxl-crawlerJava API For Chrome and Firefox
$ npx skills add fanyong920/jvppeteerElegant Scraper and Crawler Framework for Golang
$ npx skills add gocolly/collyPython ProxyPool for web spider
$ npx skills add jhao104/proxy_poolnewspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
$ npx skills add codelucas/newspaperA next-generation crawling and spidering framework.
$ npx skills add projectdiscovery/katanaWeb Crawler/Spider for NodeJS + server-side jQuery ;-)
$ npx skills add bda-research/node-crawlerPython API for JMComic | 提供Python API访问禁漫天堂,同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀
$ npx skills add hect0x7/JMComic-Crawler-PythonRedis-based components for Scrapy.
$ npx skills add rmax/scrapy-redis为所有人准备的AI搞钱团队,帮你把经验和方法跑成一门生意。
$ npx skills add TeamWiseFlow/wiseflowDotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
$ npx skills add dotnetcore/DotnetSpiderPython脚本。模拟登录知乎, 爬虫,操作excel,微信公众号,远程开机
$ npx skills add injetlee/PythonHow to choose
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Fscrawler if it already passes your workflow test and repository review.
Next step
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.