Declarative web scraping
$ npx skills add MontFerret/ferretAlternatives
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。
Declarative web scraping
$ npx skills add MontFerret/ferretA scalable web crawler framework for Java.
$ npx skills add code4craft/webmagicLightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
$ npx skills add felipecsl/wombatNewPipe's core library for extracting data from streaming sites
$ npx skills add TeamNewPipe/NewPipeExtractorA visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/网页爬虫软件,可以无代码图形化的设计和执行爬虫任务。别名:ServiceWrapper面向Web应用的智能化服务封装系统。
$ npx skills add NaiboWang/EasySpiderElasticsearch File System Crawler (FS Crawler)
$ npx skills add dadoonet/fscrawlerElegant Scraper and Crawler Framework for Golang
$ npx skills add gocolly/collyEasy to use lightweight web crawler(易用的轻量化网络爬虫)
$ npx skills add xtuhcy/geccoFess is very powerful and easily deployable Enterprise Search Server.
$ npx skills add codelibs/fess👾 Fast and simple video download library and CLI tool written in Go
$ npx skills add iawia002/luxPython ProxyPool for web spider
$ npx skills add jhao104/proxy_poolnewspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
$ npx skills add codelucas/newspaperA next-generation crawling and spidering framework.
$ npx skills add projectdiscovery/katanaDistributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
$ npx skills add crawlab-team/crawlab一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
$ npx skills add shengqiangzhang/examples-of-web-crawlers新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。
$ npx skills add ssssssss-team/spider-flowHow to choose
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep NetDiscovery if it already passes your workflow test and repository review.
Next step
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.