Awesome Web Scraping
lorien
List of libraries, tools and APIs for web scraping and data processing.
OPENAGENTSKILL / DIRECTORY
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Find a skill for your next task. Preview examples where available.
1–16 / 94
Results: 94
lorien
List of libraries, tools and APIs for web scraping and data processing.
apache
The Cloud-Native API Gateway and AI Gateway
Telegram Bot API for NodeJS
evolution-foundation
Evolution API is an open-source WhatsApp integration API
hey-api
👨🚀 Ecosystem for turning API specifications into production-ready code. Used by Vercel, OpenCode, PayPal, AWS, Autodesk, and many more.
mevdschee
Single file PHP script that adds a REST API to a SQL database
apify
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Down…
unclecode
Open-source LLM-friendly web crawler and scraper for agent workflows.
firecrawl
The API to search, scrape, and interact with the web at scale. 🔥
apify
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…
D4Vinci
Adaptive web scraping for agent data collection
scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
alphacep
Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node
pinchtab
High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.
adbar
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
go-rod
A Chrome DevTools Protocol driver for web automation and scraping.