#1
Elegant Scraper and Crawler Framework for Golang
25K starsMay 25, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/collyAlternatives
Siteone Crawler alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Siteone Crawler
SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64).
80
Quality
86
Trust
770
Stars
#2
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
15K starsMay 13, 2026 pushweb-automationPythonCrawler
$ npx skills add codelucas/newspaper#3
Open source SEO audit tool.
724 starsMay 23, 2026 pushweb-automationGoCrawler
$ npx skills add StJudeWasHere/seonaut#4
Declarative web scraping
6.0K starsJun 13, 2026 pushweb-automationGoCrawler
$ npx skills add MontFerret/ferret#5
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
3.4K starsMay 27, 2026 pushweb-automationGoCrawler
$ npx skills add edoardottt/cariddi#6
Run a high-fidelity browser-based web archiving crawler in a single Docker container
1.1K starsJun 10, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add webrecorder/browsertrix-crawler#7
蓝天采集器是一款开源免费的爬虫系统，仅需点选编辑规则即可采集数据，可运行在本地、虚拟主机或云服务器中，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统
2.1K starsApr 30, 2026 pushweb-automationPHPCrawler
$ npx skills add zorlan/skycaiji#8
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
16K starsJun 11, 2026 pushweb-automationTypeScriptBrowser Automation
$ npx skills add getmaxun/maxun#9
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
44K starsMay 22, 2026 pushweb-automationJavaScriptCrawler
$ npx skills add NaiboWang/EasySpider#10
An ergonomic Python HTTP Client with TLS fingerprint
1.4K starsJun 4, 2026 pushweb-automationRustCrawler
$ npx skills add 0x676e67/wreq-python#11
👾 Fast and simple video download library and CLI tool written in Go
31K starsMar 29, 2026 pushweb-automationGoCrawler
$ npx skills add iawia002/lux#12
Python ProxyPool for web spider
23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool#13
A next-generation crawling and spidering framework.
17K starsJun 15, 2026 pushweb-automationGoCrawler
$ npx skills add projectdiscovery/katana#14
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
12K starsFeb 10, 2026 pushweb-automationGoCrawler
$ npx skills add crawlab-team/crawlab#15
A scalable web crawler framework for Java.
12K starsDec 20, 2025 pushweb-automationJavaCrawler
$ npx skills add code4craft/webmagic#16
一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
15K starsJun 28, 2025 pushweb-automationHTMLCrawler
$ npx skills add shengqiangzhang/examples-of-web-crawlersHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Siteone Crawler if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.