#1
Elegant Scraper and Crawler Framework for Golang
25K starsMay 25, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/collyAlternatives
Crawly alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Crawly
Crawly, a high-level web crawling & scraping framework for Elixir.
84
Quality
86
Trust
1.1K
Stars
#2
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
15K starsMay 13, 2026 pushweb-automationPythonCrawler
$ npx skills add codelucas/newspaper#3
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
6.8K starsJun 4, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add bda-research/node-crawler#4
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
2.8K starsApr 16, 2025 pushweb-automationGoCrawler
$ npx skills add geziyor/geziyor#5
:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
2.7K starsJun 10, 2026 pushweb-automationPHPCrawler
$ npx skills add jae-jae/QueryList#6
A high performance web crawler / scraper in Elixir.
958 starsJun 19, 2024 pushweb-automationElixirCrawler
$ npx skills add fredwu/crawler#7
蓝天采集器是一款开源免费的爬虫系统，仅需点选编辑规则即可采集数据，可运行在本地、虚拟主机或云服务器中，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统
2.1K starsApr 30, 2026 pushweb-automationPHPCrawler
$ npx skills add zorlan/skycaiji#8
🤖 Scrape data from HTML websites automatically by just providing examples
1.4K starsMar 17, 2024 pushweb-automationPythonCrawler
$ npx skills add lorey/mlscraper#9
👾 Fast and simple video download library and CLI tool written in Go
31K starsMar 29, 2026 pushweb-automationGoCrawler
$ npx skills add iawia002/lux#10
Python ProxyPool for web spider
23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool#11
A collection of awesome web crawler,spider in different languages
7.2K starsJun 16, 2024 pushweb-automationCrawlerClaude Code
$ npx skills add BruceDone/awesome-crawler#12
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
12K starsFeb 10, 2026 pushweb-automationGoCrawler
$ npx skills add crawlab-team/crawlab#13
A scalable web crawler framework for Java.
12K starsDec 20, 2025 pushweb-automationJavaCrawler
$ npx skills add code4craft/webmagic#14
一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
15K starsJun 28, 2025 pushweb-automationHTMLCrawler
$ npx skills add shengqiangzhang/examples-of-web-crawlers#15
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
3.4K starsMay 27, 2026 pushweb-automationGoCrawler
$ npx skills add edoardottt/cariddi#16
HTTP API for Scrapy spiders
880 starsMar 20, 2026 pushweb-automationPythonCrawler
$ npx skills add scrapinghub/scrapyrtHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Crawly if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.