#1
简单易用的Python爬虫框架，QQ交流群：597510560
1.8K starsJun 10, 2022 pushweb-automationPythonCrawler
$ npx skills add xianhu/PSpiderAlternatives
Spider Flow alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Spider Flow
新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
77
Quality
83
Trust
11K
Stars
#2
蓝天采集器是一款开源免费的爬虫系统，仅需点选编辑规则即可采集数据，可运行在本地、虚拟主机或云服务器中，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统
2.1K starsApr 30, 2026 pushweb-automationPHPCrawler
$ npx skills add zorlan/skycaiji#3
A collection of awesome web crawler,spider in different languages
7.2K starsJun 16, 2024 pushweb-automationCrawlerClaude Code
$ npx skills add BruceDone/awesome-crawler#4
Elegant Scraper and Crawler Framework for Golang
25K starsMay 25, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/colly#5
Easy to use lightweight web crawler（易用的轻量化网络爬虫）
2.5K starsJan 23, 2026 pushweb-automationJavaCrawler
$ npx skills add xtuhcy/gecco#6
Python ProxyPool for web spider
23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool#7
A next-generation crawling and spidering framework.
17K starsJun 15, 2026 pushweb-automationGoCrawler
$ npx skills add projectdiscovery/katana#8
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
12K starsFeb 10, 2026 pushweb-automationGoCrawler
$ npx skills add crawlab-team/crawlab#9
一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
15K starsJun 28, 2025 pushweb-automationHTMLCrawler
$ npx skills add shengqiangzhang/examples-of-web-crawlers#10
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
6.8K starsJun 4, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add bda-research/node-crawler#11
A scalable, mature and versatile web crawler based on Apache Storm
980 starsJun 14, 2026 pushweb-automationJavaCrawler
$ npx skills add apache/stormcrawler#12
A scalable web crawler framework for Java.
12K starsDec 20, 2025 pushweb-automationJavaCrawler
$ npx skills add code4craft/webmagic#13
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
2.4K starsJun 11, 2026 pushweb-automationPHPCrawler
$ npx skills add JayBizzle/Crawler-Detect#14
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
3.7K starsJun 1, 2026 pushweb-automationPythonCrawler
$ npx skills add Boris-code/feapder#15
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
837 starsJan 12, 2026 pushweb-automationRubyCrawler
$ npx skills add postmodern/spidr#16
Every web site provides APIs.
3.6K starsJun 4, 2026 pushweb-automationPythonCrawler
$ npx skills add elliotgao2/toapiHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Spider Flow if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.