AI Agent Skills

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…

Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀

Scrapy, a fast high-level web crawling & scraping framework for Python.

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

Web crawling built for AI

Python ProxyPool for web spider

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Lighter web automation with Python

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Python scraper based on AI

🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥

The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.

PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.

Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints.

Python tool for converting files and office documents to Markdown.

Automate a real browser from the terminal for navigation, form filling, snapshots, screenshots, extraction, and UI-flow debugging.