AI Agent Skills

List of libraries, tools and APIs for web scraping and data processing.

Scrapy, a fast high-level web crawling & scraping framework for Python.

The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Web crawling built for AI

Lighter web automation with Python

Give your AI agent a web browser

Python scraper based on AI

A next-generation crawling and spidering framework.

High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.

Adaptive web scraping for agent data collection

Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, a…

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

A Chrome DevTools Protocol driver for web automation and scraping.

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Down…

The API to search, scrape, and interact with the web at scale. 🔥