#1
Python ProxyPool for web spider
23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_poolAlternatives
AutoCrawler alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
AutoCrawler
Google, Naver multiprocess image web crawler (Selenium)
73
Quality
82
Trust
1.7K
Stars
#2
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
15K starsMay 13, 2026 pushweb-automationPythonCrawler
$ npx skills add codelucas/newspaper#3
Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀
6.0K starsJun 11, 2026 pushweb-automationPythonCrawler
$ npx skills add hect0x7/JMComic-Crawler-Python#4
Redis-based components for Scrapy.
5.6K starsMay 19, 2026 pushweb-automationPythonCrawler
$ npx skills add rmax/scrapy-redis#5
Python脚本。模拟登录知乎， 爬虫，操作excel，微信公众号，远程开机
11K starsMay 9, 2026 pushweb-automationPythonCrawler
$ npx skills add injetlee/Python#6
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
3.7K starsJun 1, 2026 pushweb-automationPythonCrawler
$ npx skills add Boris-code/feapder#7
Every web site provides APIs.
3.6K starsJun 4, 2026 pushweb-automationPythonCrawler
$ npx skills add elliotgao2/toapi#8
基于搜狗微信搜索的微信公众号爬虫接口
6.3K starsMar 7, 2026 pushweb-automationPythonCrawler
$ npx skills add chyroc/WechatSogou#9
Web crawling framework based on asyncio.
2.0K starsJun 4, 2026 pushweb-automationPythonCrawler
$ npx skills add elliotgao2/gain#10
A web privacy measurement framework
1.4K starsJun 16, 2026 pushweb-automationPythonCrawler
$ npx skills add openwpm/OpenWPM#11
新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频
4.5K starsMay 10, 2026 pushweb-automationPythonCrawler
$ npx skills add dataabc/weibo-crawler#12
📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
1.1K starsApr 30, 2026 pushweb-automationPythonCrawler
$ npx skills add AndyTheFactory/newspaper4k#13
一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
15K starsJun 28, 2025 pushweb-automationHTMLCrawler
$ npx skills add shengqiangzhang/examples-of-web-crawlers#14
:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis
5.5K starsDec 26, 2022 pushweb-automationPythonCrawler
$ npx skills add SpiderClub/haipproxy#15
Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era
4.0K starsJun 9, 2025 pushweb-automationPythonCrawler
$ npx skills add MikeChongCan/scylla#16
Easily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片，视频
1.2K starsDec 26, 2025 pushweb-automationPythonCrawler
$ npx skills add dixudx/tumblr-crawlerHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep AutoCrawler if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.