Awesome Web Scraping
lorien
List of libraries, tools and APIs for web scraping and data processing.
7.9KGitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Find a skill for your next task. Preview examples where available.
Results · “web-crawling”
1–16 / 102
Results: 102
Webapp Testing
anthropics
Use Playwright to interact with and test local web applications, capture screenshots, debug UI behavior, and inspect browser logs.
179.8KGitHub
Crawl4AI
unclecode
Web crawling built for AI
73.1KGitHub
Firecrawl
firecrawl
Web data for AI applications
134.2KGitHub
Scrapy
scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
62.5KGitHub
Web Dev For Beginners
microsoft
24 Lessons, 12 Weeks, Get Started as a Web Developer
95.9KGitHub
Web Design Guidelines
vercel-labs
Review UI code for web interface guidelines, UX quality, accessibility, and interaction design best practices.
32KGitHub
Web Ui
browser-use
🖥️ Run AI Agent in your browser.
16.1KGitHub
Material Web
material-components
11KGitHub
Rod
go-rod
A Chrome DevTools Protocol driver for web automation and scraping.
7KGitHub
Crawlee
apify
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Down…
25.7KGitHub
The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.
2.9KGitHub
Autoscraper
alirezamika
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
7.9KGitHub
Helium
mherrmann
Lighter web automation with Python
8.3KGitHub
Crawlee Python
apify
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…
9.5KGitHub
Hermes Web Ui
EKKOLearnAI
Web dashboard for Hermes Agent — multi-platform AI chat, session management, scheduled jobs, usage analytics
9.3KGitHub