AI Agent Skills

List of libraries, tools and APIs for web scraping and data processing.

Capture screenshots of websites

Open-source LLM-friendly web crawler and scraper for agent workflows.

Plugin for website-scraper which returns html for dynamic websites using puppeteer

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM…

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, a…

Adaptive web scraping for agent data collection

Scrapy, a fast high-level web crawling & scraping framework for Python.

Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Down…

AI Map is an AI-powered website mapping tool by Oxylabs AI Studio that uses natural language prompts to intelligently discover and extract relevant URLs from any website.

High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.

A Chrome DevTools Protocol driver for web automation and scraping.

Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.

Swiss-army tool for scraping and extracting data from online assets, made for hackers