AI Agent Skills

List of libraries, tools and APIs for web scraping and data processing.

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Down…

Open-source LLM-friendly web crawler and scraper for agent workflows.

The API to search, scrape, and interact with the web at scale. 🔥

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…

Adaptive web scraping for agent data collection

Scrapy, a fast high-level web crawling & scraping framework for Python.

High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

A Chrome DevTools Protocol driver for web automation and scraping.

🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥

A developer-friendly API for converting many document formats into PDF files, and more!

Google Maps Scraper & Lead Generation Tool. Extract 50+ data points including business emails, phone numbers, and social profiles. Includes enrichment features, API acce…

The headless browser for AI agents and web scraping

An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of th…

SeleniumBase is a framework for UI Testing, Web Scraping, and Stealth. Passes every bot-detection test with CDP Mode, and extends Playwright.