High-throughput crawling and scraping for agent data pipelines
$ npx skills add scrapy/scrapyAlternatives
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Turn websites into structured APIs for agents
High-throughput crawling and scraping for agent data pipelines
$ npx skills add scrapy/scrapyAdaptive web scraping for agent data collection
$ npx skills add D4Vinci/ScraplingElegant Scraper and Crawler Framework for Golang
$ npx skills add gocolly/collyBuild reliable crawlers for LLM and RAG data ingestion
$ npx skills add apify/crawleeClone any website with one command using AI coding agents
$ npx skills add JCodesMore/ai-website-cloner-templateA scalable web crawler framework for Java.
$ npx skills add code4craft/webmagic为你 7*24 在线搞钱的“云上牛马”团队
$ npx skills add TeamWiseFlow/wiseflowWeb Crawler/Spider for NodeJS + server-side jQuery ;-)
$ npx skills add bda-research/node-crawlerThe undetected self-hosted browser automation platform. Powered by Camoufox (Firefox) for 0% detection rates. Built for speed, privacy, and scalability.
$ npx skills add saifyxpro/HeadlessXOpen-source LLM-friendly web crawler and scraper
$ npx skills add unclecode/crawl4aiBest and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, and website defacement monitoring—all for free or enjoy our SaaS plan!
$ npx skills add dgtlmoon/changedetection.ioExtract web data with LLM-guided scraping graphs
$ npx skills add ScrapeGraphAI/Scrapegraph-aiA visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/网页爬虫软件,可以无代码图形化的设计和执行爬虫任务。别名:ServiceWrapper面向Web应用的智能化服务封装系统。
$ npx skills add NaiboWang/EasySpider👾 Fast and simple video download library and CLI tool written in Go
$ npx skills add iawia002/luxLighter web automation with Python
$ npx skills add mherrmann/heliumTransform Web Content into LLM-Ready Data
$ npx skills add watercrawl/WaterCrawlHow to choose
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Maxun if it already passes your workflow test and repository review.
Next step
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.