AI Agent Skills

Automate a real browser from the terminal for navigation, form filling, snapshots, screenshots, extraction, and UI-flow debugging.

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…

Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀

Lighter web automation with Python

Give your AI agent a web browser

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Down…

Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints.

Scrapy, a fast high-level web crawling & scraping framework for Python.

Python ProxyPool for web spider

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Python scraper based on AI

The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Open-source LLM-friendly web crawler and scraper for agent workflows.

Turn websites into clean markdown or structured data for retrieval and agents.