AI Agent Skills

Scrapy, a fast high-level web crawling & scraping framework for Python.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…

Python scraper based on AI

Adaptive web scraping for agent data collection

Web crawling built for AI

Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, a…

Give your AI agent a web browser

Python tool for converting files and office documents to Markdown.

High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.

Python ProxyPool for web spider

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

The API to search, scrape, and interact with the web at scale. 🔥

SeleniumBase is a framework for UI Testing, Web Scraping, and Stealth. Passes every bot-detection test with CDP Mode, and extends Playwright.

Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.

Elegant Scraper and Crawler Framework for Golang