AI Agent Skills

List of libraries, tools and APIs for web scraping and data processing.

Open-source LLM-friendly web crawler and scraper for agent workflows.

Adaptive web scraping for agent data collection

Scrapy, a fast high-level web crawling & scraping framework for Python.

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

A Chrome DevTools Protocol driver for web automation and scraping.

OCR powered screen-capture tool to capture information instead of images

Copy any text on your screen, stop retyping.

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Down…

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM…

Web Scraping Framework

Simple web scraping for R

The complete web scraping toolkit for PHP.

Scraping publicly-accessible Letterboxd data and creating a movie recommendation model with it that can generate recommendations when provided with a Letterboxd username

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…

ShareX is a free and open-source application that enables users to capture or record any area of their screen with a single keystroke. It also supports uploading images,…