#1
Scrapy, a fast high-level web crawling & scraping framework for Python.
62K starsJun 11, 2026 pushweb-automationPythonWeb Automation
$ npx skills add scrapy/scrapyAlternatives
Deepcrawl alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Deepcrawl
100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.
75
Quality
85
Trust
580
Stars
#2
A Chrome DevTools Protocol driver for web automation and scraping.
7.0K starsMay 24, 2026 pushweb-automationGoWeb Automation
$ npx skills add go-rod/rod#3
List of libraries, tools and APIs for web scraping and data processing.
7.9K starsMay 28, 2026 pushweb-automationMakefileWeb Automation
$ npx skills add lorien/awesome-web-scraping#4
Elegant Scraper and Crawler Framework for Golang
25K starsJun 18, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/colly#5
Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, and website defacement monitoring—all for free or enjoy our SaaS plan!
32K starsJun 3, 2026 pushweb-automationPythonWeb Automation
$ npx skills add dgtlmoon/changedetection.io#6
Web Scraping Framework
2.5K starsSep 19, 2025 pushweb-automationPythonWeb Automation
$ npx skills add lorien/grab#7
Python scraper based on AI
27K starsJun 15, 2026 pushweb-automationPythonWeb Automation
$ npx skills add ScrapeGraphAI/Scrapegraph-ai#8
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
16K starsJun 11, 2026 pushweb-automationTypeScriptBrowser Automation
$ npx skills add getmaxun/maxun#9
Adaptive web scraping for agent data collection
54K starsMay 18, 2026 pushweb-automationPythonWeb Automation
$ npx skills add D4Vinci/Scrapling#10
🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音、快手、TikTok、Bilibili数据爬取工具，支持API调用，在线批量解析及下载。
18K starsOct 12, 2025 pushweb-automationPythonWeb Automation
$ npx skills add Evil0ctal/Douyin_TikTok_Download_API#11
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
6.1K starsJun 10, 2026 pushweb-automationPythonWeb Automation
$ npx skills add adbar/trafilatura#12
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints.
5.8K starsJun 7, 2026 pushweb-automationPythonWeb Automation
$ npx skills add lexiforest/curl_cffi#13
Lighter web automation with Python
8.3K starsJun 3, 2026 pushweb-automationPythonWeb Automation
$ npx skills add mherrmann/helium#14
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
3.3K starsJun 10, 2026 pushweb-automationPHPWeb Automation
$ npx skills add php-curl-class/php-curl-class#15
Free anti fingerprint browser, 指纹浏览器, 隐私浏览器, 防识别浏览器, 反识别浏览器, 防关联浏览器, 免费的web3空投专用指纹浏览器 https://virtualbrowser.cc/?src=github
2.9K starsMay 17, 2026 pushweb-automationVueWeb Automation
$ npx skills add Virtual-Browser/VirtualBrowser#16
The complete web scraping toolkit for PHP.
1.5K starsOct 27, 2025 pushweb-automationPHPWeb Automation
$ npx skills add roach-php/coreHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Deepcrawl if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.