Alternatives

Examples Of Web Crawlers alternatives for AI agents.

Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.

Current skill

Examples Of Web Crawlers

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

97
Quality
93
Trust
15K
Stars
#1

Proxy Pool

Similarity 127Trust 94Excellent 100

Python ProxyPool for web spider

23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool
#2

Feapder

Similarity 123Trust 91Excellent 100

🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单,功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度

3.7K starsJun 1, 2026 pushweb-automationPythonCrawler
$ npx skills add Boris-code/feapder
#3

Toapi

Similarity 123Trust 90Excellent 100

Every web site provides APIs.

3.6K starsJun 4, 2026 pushweb-automationPythonCrawler
$ npx skills add elliotgao2/toapi
#4

Gain

Similarity 123Trust 92Excellent 100

Web crawling framework based on asyncio.

2.0K starsJun 4, 2026 pushweb-automationPythonCrawler
$ npx skills add elliotgao2/gain
#5

Douyin

Similarity 120Trust 87Excellent 92

抖音爬虫——采集账号主页、喜欢、收藏、音乐原声、话题、搜索、合集、作品、关注、粉丝等公开数据。

1.6K starsJun 3, 2026 pushweb-automationCrawlerClaude Code
$ npx skills add erma0/douyin
#6

Colly

Similarity 120Trust 96Excellent 100

Elegant Scraper and Crawler Framework for Golang

25K starsMay 25, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/colly
#7

Haipproxy

Similarity 119Trust 87Strong 78

:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis

5.5K starsDec 26, 2022 pushweb-automationPythonCrawler
$ npx skills add SpiderClub/haipproxy
#8

Newspaper

Similarity 119Trust 97Excellent 100

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

15K starsMay 13, 2026 pushweb-automationPythonCrawler
$ npx skills add codelucas/newspaper
#9

Crawlab

Similarity 118Trust 94Excellent 100

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架

12K starsFeb 10, 2026 pushweb-automationGoCrawler
$ npx skills add crawlab-team/crawlab
#10

Spider Reverse

Similarity 118Trust 88Excellent 87

爬虫逆向案例,已完成:TLS指纹|瑞数|震坤行 | 网易易盾 | 微信小程序反编译逆向(百达星系) | 同花顺 | rpc解密 | 加速乐 | 极验滑块验证码 | 巨量算数 | Boss直聘 | 企查查 | 中国五矿 | qq音乐 | 产业政策大数据平台 | 企知道 | 雪球网(acw_sc__v2) | 1688 | 七麦数据 | whggzy | 企名科技 | mohurd | 艺恩数据 | 欧科云链

881 starsMay 29, 2026 pushweb-automationPythonCrawler
$ npx skills add 0xAllenChen/spider_reverse
#11

Node Crawler

Similarity 117Trust 95Excellent 100

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

6.8K starsJun 4, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add bda-research/node-crawler
#12

JMComic Crawler Python

Similarity 117Trust 95Excellent 100

Python API for JMComic | 提供Python API访问禁漫天堂,同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀

6.0K starsJun 11, 2026 pushweb-automationPythonCrawler
$ npx skills add hect0x7/JMComic-Crawler-Python
#13

Scrapy Redis

Similarity 117Trust 94Excellent 100

Redis-based components for Scrapy.

5.6K starsMay 19, 2026 pushweb-automationPythonCrawler
$ npx skills add rmax/scrapy-redis
#14

Python

Similarity 116Trust 88Excellent 96

Python脚本。模拟登录知乎, 爬虫,操作excel,微信公众号,远程开机

11K starsMay 9, 2026 pushweb-automationPythonCrawler
$ npx skills add injetlee/Python
#15

Crawler Detect

Similarity 115Trust 96Excellent 100

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

2.4K starsJun 11, 2026 pushweb-automationPHPCrawler
$ npx skills add JayBizzle/Crawler-Detect
#16

Spider Collection

Similarity 115Trust 84Strong 72

python爬虫,目前库存:网易云音乐歌曲爬取,B站视频爬取,知乎问答爬取,壁纸爬取,xvideos视频爬取,有声书爬取,微博爬虫,安居客信息爬取+数据可视化,哔哩哔哩视频封面提取器,ip代理池封装,知乎百万级用户爬虫+数据分析,github用户爬虫

1.6K starsApr 23, 2024 pushweb-automationPythonCrawler
$ npx skills add srx-2000/spider_collection

How to choose

When should you switch?

Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Examples Of Web Crawlers if it already passes your workflow test and repository review.

Next step

Compare top candidates side by side

Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.