AI Agent Skills

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…

Python tool for converting files and office documents to Markdown.

Python scraper based on AI

Scrapy, a fast high-level web crawling & scraping framework for Python.

Python ProxyPool for web spider

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Lighter web automation with Python

The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.

PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Give your AI agent a web browser

Automate a real browser from the terminal for navigation, form filling, snapshots, screenshots, extraction, and UI-flow debugging.

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for languag…

An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of th…