Alternatives

Crawler alternatives for AI agents.

Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.

Current skill

Crawler

K 哥爬虫代码分享,JS 逆向,爬虫进阶。关注公众号:K哥爬虫

67
Quality
81
Trust
1.4K
Stars
#1

Node Crawler

Similarity 133Trust 95Excellent 100

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

6.8K starsJun 18, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add bda-research/node-crawler
#2

Google Play Scraper

Similarity 129Trust 89Excellent 100

Node.js scraper to get data from Google Play

2.9K starsMay 31, 2026 pushweb-automationJavaScriptCrawler
$ npx skills add facundoolano/google-play-scraper
#3

Colly

Similarity 128Trust 96Excellent 100

Elegant Scraper and Crawler Framework for Golang

25K starsJun 18, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/colly
#4

Proxy Pool

Similarity 127Trust 94Excellent 100

Python ProxyPool for web spider

23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool
#5

Crawler Detect

Similarity 123Trust 96Excellent 100

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

2.4K starsJun 11, 2026 pushweb-automationPHPCrawler
$ npx skills add JayBizzle/Crawler-Detect
#6

Feapder

Similarity 123Trust 91Excellent 100

🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单,功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度

3.7K starsJun 1, 2026 pushweb-automationPythonCrawler
$ npx skills add Boris-code/feapder
#7

QueryList

Similarity 123Trust 89Excellent 100

:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

2.7K starsJun 10, 2026 pushweb-automationPHPCrawler
$ npx skills add jae-jae/QueryList
#8

Gain

Similarity 123Trust 92Excellent 100

Web crawling framework based on asyncio.

2.0K starsJun 4, 2026 pushweb-automationPythonCrawler
$ npx skills add elliotgao2/gain
#9

Beanbun

Similarity 122Trust 92Excellent 100

Beanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性,基于 Workerman。

1.3K starsMay 26, 2026 pushweb-automationPHPCrawler
$ npx skills add kiddyuchina/Beanbun
#10

Skycaiji

Similarity 121Trust 90Excellent 94

蓝天采集器是一款开源免费的爬虫系统,仅需点选编辑规则即可采集数据,可运行在本地、虚拟主机或云服务器中,几乎能采集所有类型的网页,无缝对接各类CMS建站程序,免登录实时发布数据,全自动无需人工干预!是网页大数据采集软件中完全跨平台的云端爬虫系统

2.1K starsApr 30, 2026 pushweb-automationPHPCrawler
$ npx skills add zorlan/skycaiji
#11

Newcrawler

Similarity 121Trust 70Needs review 49

Free Web Scraping Tool with Java

586 starsNov 25, 2023 pushweb-automationJavaScriptCrawler
$ npx skills add speed/newcrawler
#12

Article Extractor

Similarity 120Trust 92Excellent 98

To extract main article from given URL with Node.js

1.9K starsMay 3, 2026 pushweb-automationJavaScriptCrawler
$ npx skills add extractus/article-extractor
#13

Pxer

Similarity 120Trust 84Strong 70

A tool for pixiv.net. 人人可用的P站爬虫

1.0K starsMar 3, 2025 pushweb-automationJavaScriptCrawler
$ npx skills add pea3nut/Pxer
#14

Douyin

Similarity 120Trust 87Excellent 92

抖音爬虫——采集账号主页、喜欢、收藏、音乐原声、话题、搜索、合集、作品、关注、粉丝等公开数据。

1.6K starsJun 3, 2026 pushweb-automationCrawlerClaude Code
$ npx skills add erma0/douyin
#15

Awesome Crawler

Similarity 119Trust 85Strong 79

A collection of awesome web crawler,spider in different languages

7.2K starsJun 16, 2024 pushweb-automationCrawlerClaude Code
$ npx skills add BruceDone/awesome-crawler
#16

Sperm

Similarity 119Trust 87Excellent 91

浏览过的精彩逆向文章汇总,值得一看

1.4K starsApr 13, 2026 pushweb-automationCrawlerClaude Code
$ npx skills add darbra/sperm

How to choose

When should you switch?

Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Crawler if it already passes your workflow test and repository review.

Next step

Compare top candidates side by side

Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.