Awesome Web Scraping
lorien
List of libraries, tools and APIs for web scraping and data processing.
Web ScrapingReview before use
7.9KGitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Search retrieves candidates across the registry and ranks a bounded shortlist by task fit. This count is matching candidates, not the registry total. No suitable match? Try a specific tool or task.
Results · “ecommerce-scraping”
1–16 / 34
More filters · 1
Results: 34
Webscraping From 0 To Hero
TheWebScrapingClub
The web scraping open project repository aims to share knowledge and experiences about web scraping with Python
1.7KGitHub
66KGitHub
70KGitHub
Scrapy
scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Web ScrapingReview before use
62.5KGitHub
Trafilatura
adbar
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Web ScrapingReview before use
6.4KGitHub
Rod
go-rod
A Chrome DevTools Protocol driver for web automation and scraping.
Web ScrapingReview before use
7KGitHub
4.7KGitHub
34KGitHub
Crawlee
apify
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Down…
25.7KGitHub
Oxylabs AI Studio Py
oxylabs
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM…
2.9KGitHub
2.5KGitHub
Geziyor
geziyor
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
Web ScrapingReview before use
2.8KGitHub
2.4KGitHub
1.5KGitHub
1.5KGitHub
External platform skills
Browse external directory →Owner-curated external sources. Not filtered by the scores or compatibility controls above; excluded from GitHub rankings and automatic installation.
No external entries match this query.