Scrapy
VERIFIED
High-throughput crawling and scraping for agent data pipelines
Downloads 0
Stars 61.8K
Version 1.0.0
Install with one command
$ npx skills add scrapy/scrapyOverview
High-throughput crawling and scraping for agent data pipelines
Imported from GitHub high-star repositories on 2026-05-21 to broaden the Open Agent Skill catalog.
Platform Compatibility
pythonFULL
crawlerFULL
ragFULL
Technical Details
- Version
- 1.0.0
- License
- Unknown
- Last Updated
- 5/22/2026
- Published
- 5/21/2026
Frameworks & Tools
PythonCrawlerRAG
Author
S
scrapy✓
@scrapy
Trust & Safety
- —Open source (public GitHub repo)
- —AI static analysis passed
- —License: Unknown
- —Manually verified by team
Related Skills
Crawl4AI
Open-source LLM-friendly web crawler and scraper
66.0K stars · 31.0K installsScrapling
Adaptive web scraping for agent data collection
52.7K stars · 0 installsFirecrawl
Turn any website into LLM-ready markdown or structured data
122.8K stars · 25.0K installsBrowser Use
Make AI agents interact with websites using natural language
95.0K stars · 28.0K installs