Scrapy
scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Web ScrapingReview before use
62.5KGitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Search retrieves candidates across the registry and ranks a bounded shortlist by task fit. This count is matching candidates, not the registry total. No suitable match? Try a specific tool or task.
Results · “git-scraping”
1–14 / 14
More filters · 1
Results: 14
Awesome Web Scraping
lorien
List of libraries, tools and APIs for web scraping and data processing.
Web ScrapingReview before use
7.9KGitHub
DotnetSpider
dotnetcore
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Web ScrapingReview before use
4.1KGitHub
66KGitHub
70KGitHub
Trafilatura
adbar
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Web ScrapingReview before use
6.4KGitHub
Rod
go-rod
A Chrome DevTools Protocol driver for web automation and scraping.
Web ScrapingReview before use
7KGitHub
34KGitHub
Crawlee
apify
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Down…
25.7KGitHub
Crawlee Python
apify
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…
9.5KGitHub
16KGitHub
Maxun
getmaxun
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
16.2KGitHub
6KGitHub
Browser Fingerprinting
niespodd
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping…
5KGitHub
External platform skills
Browse external directory →Owner-curated external sources. Not filtered by the scores or compatibility controls above; excluded from GitHub rankings and automatic installation.
No external entries match this query.