#1
A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
2.8K starsJul 3, 2021 pushweb-automationHTMLCrawler
$ npx skills add NikolaiT/GoogleScraperAlternatives
Crawler Illegal Cases In China alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Crawler Illegal Cases In China
Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律，避免触碰数据合规红线。
93
Quality
88
Trust
4.6K
Stars
#2
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
44K starsMay 22, 2026 pushweb-automationJavaScriptCrawler
$ npx skills add NaiboWang/EasySpider#3
Elegant Scraper and Crawler Framework for Golang
25K starsMay 25, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/colly#4
Python ProxyPool for web spider
23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool#5
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
15K starsMay 13, 2026 pushweb-automationPythonCrawler
$ npx skills add codelucas/newspaper#6
A next-generation crawling and spidering framework.
17K starsJun 15, 2026 pushweb-automationGoCrawler
$ npx skills add projectdiscovery/katana#7
A scalable web crawler framework for Java.
12K starsDec 20, 2025 pushweb-automationJavaCrawler
$ npx skills add code4craft/webmagic#8
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
6.8K starsJun 4, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add bda-research/node-crawler#9
Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀
6.0K starsJun 11, 2026 pushweb-automationPythonCrawler
$ npx skills add hect0x7/JMComic-Crawler-Python#10
Redis-based components for Scrapy.
5.6K starsMay 19, 2026 pushweb-automationPythonCrawler
$ npx skills add rmax/scrapy-redis#11
为所有人准备的AI搞钱团队，帮你把经验和方法跑成一门生意。
8.2K starsJun 5, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add TeamWiseFlow/wiseflow#12
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
4.1K starsApr 3, 2026 pushweb-automationC#Crawler
$ npx skills add dotnetcore/DotnetSpider#13
Python脚本。模拟登录知乎， 爬虫，操作excel，微信公众号，远程开机
11K starsMay 9, 2026 pushweb-automationPythonCrawler
$ npx skills add injetlee/Python#14
一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
15K starsJun 28, 2025 pushweb-automationHTMLCrawler
$ npx skills add shengqiangzhang/examples-of-web-crawlers#15
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
2.4K starsJun 11, 2026 pushweb-automationPHPCrawler
$ npx skills add JayBizzle/Crawler-Detect#16
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
3.7K starsJun 1, 2026 pushweb-automationPythonCrawler
$ npx skills add Boris-code/feapderHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Crawler Illegal Cases In China if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.