Elegant Scraper and Crawler Framework for Golang
$ npx skills add gocolly/collyAlternatives
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
A next-generation crawling and spidering framework.
Elegant Scraper and Crawler Framework for Golang
$ npx skills add gocolly/collyDeclarative web scraping
$ npx skills add MontFerret/ferretTake a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
$ npx skills add edoardottt/cariddiWebsite Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
$ npx skills add goclone-dev/goclone👾 Fast and simple video download library and CLI tool written in Go
$ npx skills add iawia002/luxDistributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
$ npx skills add crawlab-team/crawlab🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
$ npx skills add JayBizzle/Crawler-DetectPython ProxyPool for web spider
$ npx skills add jhao104/proxy_poolnewspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
$ npx skills add codelucas/newspaperIncredibly fast crawler designed for OSINT.
$ npx skills add s0md3v/PhotonA scalable web crawler framework for Java.
$ npx skills add code4craft/webmagic为你 7*24 在线搞钱的“云上牛马”团队
$ npx skills add TeamWiseFlow/wiseflowWeb Crawler/Spider for NodeJS + server-side jQuery ;-)
$ npx skills add bda-research/node-crawlerPython脚本。模拟登录知乎, 爬虫,操作excel,微信公众号,远程开机
$ npx skills add injetlee/PythonPython API for JMComic | 提供Python API访问禁漫天堂,同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀
$ npx skills add hect0x7/JMComic-Crawler-PythonRedis-based components for Scrapy.
$ npx skills add rmax/scrapy-redisHow to choose
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Katana if it already passes your workflow test and repository review.
Next step
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.