AI Agent Skills

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

Google Maps Scraper & Lead Generation Tool. Extract 50+ data points including business emails, phone numbers, and social profiles. Includes enrichment features, API acce…

Python scraper based on AI

Web crawling built for AI

Scrapy, a fast high-level web crawling & scraping framework for Python.

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Python ProxyPool for web spider

Lighter web automation with Python

Elegant Scraper and Crawler Framework for Golang

Turn websites into clean markdown or structured data for retrieval and agents.

Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints.

Automate a real browser from the terminal for navigation, form filling, snapshots, screenshots, extraction, and UI-flow debugging.

The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.