AI Agent Skills

Scrapy, a fast high-level web crawling & scraping framework for Python.

Redis-based components for Scrapy.

HTTP API for Scrapy spiders

🎭 Playwright integration for Scrapy

Random User-Agent middleware based on fake-useragent

:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis

Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup

爬虫管理系统,爬虫管理平台,分布式爬虫管理平台, 流程编排,openclaw龙虾,AI助手,可视化操作,完整监控,灵活的Python环境管理,,环境隔离,资源占用小,支持 Scrapy 等主流爬虫框架,支持 Selenium、Playwright、DrissionPage 等浏览器自动化工具,支持node环境下的js逆向代码,支持win…

A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.