#1
Elegant Scraper and Crawler Framework for Golang
25K starsMay 25, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/collyAlternatives
Go Spider alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Go Spider
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
73
Quality
84
Trust
1.8K
Stars
#2
A next-generation crawling and spidering framework.
17K starsJun 15, 2026 pushweb-automationGoCrawler
$ npx skills add projectdiscovery/katana#3
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
12K starsFeb 10, 2026 pushweb-automationGoCrawler
$ npx skills add crawlab-team/crawlab#4
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
2.8K starsApr 16, 2025 pushweb-automationGoCrawler
$ npx skills add geziyor/geziyor#5
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
2.1K starsJun 2, 2026 pushweb-automationGoCrawler
$ npx skills add goclone-dev/goclone#6
Gospider - Fast web spider written in Go
3.0K starsApr 21, 2024 pushweb-automationGoCrawler
$ npx skills add jaeles-project/gospider#7
Python ProxyPool for web spider
23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool#8
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
6.8K starsJun 4, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add bda-research/node-crawler#9
👾 Fast and simple video download library and CLI tool written in Go
31K starsMar 29, 2026 pushweb-automationGoCrawler
$ npx skills add iawia002/lux#10
小说下载|小说爬取|起点|笔趣阁|导出Markdown|导出txt|转换epub|广告过滤|自动校对
956 starsJan 21, 2025 pushweb-automationGoCrawler
$ npx skills add ma6254/FictionDown#11
Automatically crawls proxy nodes on the public internet, de-duplicates and tests for usability and then provides a list of nodes
4.0K starsApr 10, 2023 pushweb-automationGoCrawler
$ npx skills add zu1k/proxypool#12
Golang短视频去水印：抖音,皮皮虾,火山,微视,最右,快手,全民小视频,皮皮搞笑,西瓜视频,虎牙,梨视频,acfun,好看视频...
946 starsJun 12, 2026 pushweb-automationGoCrawler
$ npx skills add wujunwei928/parse-video#13
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
2.4K starsJun 11, 2026 pushweb-automationPHPCrawler
$ npx skills add JayBizzle/Crawler-Detect#14
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
3.7K starsJun 1, 2026 pushweb-automationPythonCrawler
$ npx skills add Boris-code/feapder#15
:paw_prints: Creeper - The Next Generation Crawler Framework (Go)
778 starsMay 16, 2017 pushweb-automationGoCrawler
$ npx skills add wspl/creeper#16
:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
2.7K starsJun 10, 2026 pushweb-automationPHPCrawler
$ npx skills add jae-jae/QueryListHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Go Spider if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.