#1
Scrapy, a fast high-level web crawling & scraping framework for Python.
63K starsJun 25, 2026 pushweb-automationPythonWeb Automation
$ npx skills add scrapy/scrapyAlternatives
Awesome Web Scraping alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Awesome Web Scraping
List of libraries, tools and APIs for web scraping and data processing.
99
Quality
86
Trust
7.9K
Stars
#2
Elegant Scraper and Crawler Framework for Golang
25K starsJun 18, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/colly#3
Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, and website defacement monitoring—all for free or enjoy our SaaS plan!
32K starsJun 3, 2026 pushweb-automationPythonWeb Automation
$ npx skills add dgtlmoon/changedetection.io#4
Python scraper based on AI
27K starsJun 15, 2026 pushweb-automationPythonWeb Automation
$ npx skills add ScrapeGraphAI/Scrapegraph-ai#5
Adaptive web scraping for agent data collection
70K starsJul 15, 2026 pushweb-automationPythonWeb Automation
$ npx skills add D4Vinci/Scrapling#6
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
7.9K starsJul 29, 2026 pushweb-automationPythonWeb Automation
$ npx skills add alirezamika/autoscraper#7
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
6.4K starsAug 4, 2026 pushweb-automationPythonWeb Automation
$ npx skills add adbar/trafilatura#8
Lighter web automation with Python
8.3K starsJun 3, 2026 pushweb-automationPythonWeb Automation
$ npx skills add mherrmann/helium#9
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
15K starsJul 8, 2026 pushweb-automationPythonCrawler
$ npx skills add codelucas/newspaper#10
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
16K starsJul 2, 2026 pushweb-automationTypeScriptBrowser Automation
$ npx skills add getmaxun/maxun#11
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
44K starsMay 22, 2026 pushweb-automationJavaScriptCrawler
$ npx skills add NaiboWang/EasySpider#12
Open-source LLM-friendly web crawler and scraper
73K starsJul 15, 2026 pushweb-automationClaudeGPT-4
$ npx skills add unclecode/crawl4ai#13
Python ProxyPool for web spider
23K starsJun 9, 2026 pushweb-automationPythonCrawler
$ npx skills add jhao104/proxy_pool#14
👾 Fast and simple video download library and CLI tool written in Go
31K starsMar 29, 2026 pushweb-automationGoCrawler
$ npx skills add iawia002/lux#15
A next-generation crawling and spidering framework.
17K starsJun 22, 2026 pushweb-automationGoCrawler
$ npx skills add projectdiscovery/katana#16
为所有人准备的AI搞钱团队，帮你把经验和方法跑成一门生意。
8.3K starsJun 5, 2026 pushweb-automationTypeScriptCrawler
$ npx skills add TeamWiseFlow/wiseflowHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Awesome Web Scraping if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.