AI Agent Skill Repository

AI Agent Skills Directory

Browse reusable skills for Codex, Claude Code, Cursor, finance, research, web scraping, PPT, football analytics, data, marketing, design, and more.

Live registry search

Results for “crawler-python

Exact name and slug matches are checked against the live registry before ranked alternatives.

Clear search

Decision filters

Choose by scenario, quality, and trust signals.

Showing 1-16 of 189 ranked candidates matching "crawler-python"

Best blend of relevance, quality, freshness, and verified outcomes

1

JMComic Crawler Python

VERIFIEDEXCELLENT · 98TRUST · 88SAFE · REVIEWEDCODING

Python API for JMComic | 提供Python API访问禁漫天堂,同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀

$ npx skills add hect0x7/JMComic-Crawler-Python
6.5K stars65 quality88 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by hect0x7DetailsQuick view
2

Python

VERIFIEDEXCELLENT · 92TRUST · 83SAFE · REVIEWEDCODING

Python脚本。模拟登录知乎, 爬虫,操作excel,微信公众号,远程开机

$ npx skills add injetlee/Python
10.7K stars64 quality83 trustReviewed with permission notes4mo since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by injetleeDetailsQuick view
3

MediaCrawler

EXCELLENT · 100TRUST · 84SAFE · REVIEWEDCODING

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 知乎问答文章 | 评论爬虫。支持多平台社交媒体内容抓取,提供完整的数据采集解决方案。

$ npx skills add NanmiCoder/MediaCrawler
1 agent calls100% success56.9K stars68 quality84 trustReviewed1mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

python
by NanmiCoderDetailsQuick view
4

Node Crawler

VERIFIEDEXCELLENT · 98TRUST · 87SAFE · REVIEWEDRESEARCH

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

$ npx skills add bda-research/node-crawler
6.8K stars66 quality87 trustReviewed2mo since pushSafe to try

Scenario Research agents

CLI + Codex · 4 targets

typescriptcrawler
by bda-researchDetailsQuick view
5

Crawlee Python

VERIFIEDEXCELLENT · 100TRUST · 86SAFE · REVIEWEDRESEARCH

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…

$ npx skills add apify/crawlee-python
9.2K stars66 quality86 trustReviewedOpenAI Agents + Browser agents2mo since pushSafe to try

Scenario Document processing

OpenAI Agents + Browser agents · 4 targets

pythonplaywright
by apifyDetailsQuick view
6

Autoscraper

VERIFIEDEXCELLENT · 100TRUST · 87SAFE · REVIEWEDCODING

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

$ npx skills add alirezamika/autoscraper
7.9K stars69 quality87 trustReviewed24d since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

pythonweb-automation
by alirezamikaDetailsQuick view
7

Playwright Python

VERIFIEDEXCELLENT · 100TRUST · 86SAFE · REVIEWEDCODING

Python version of the Playwright testing and automation library.

$ npx skills add microsoft/playwright-python
14.8K stars69 quality86 trustReviewedBrowser agents1mo since pushSafe to try

Scenario Testing and QA

Browser agents + CLI · 4 targets

pythonplaywright
by microsoftDetailsQuick view
8

Proxy Pool

VERIFIEDEXCELLENT · 100TRUST · 87SAFE · REVIEWEDCODING

Python ProxyPool for web spider

$ npx skills add jhao104/proxy_pool
23.4K stars71 quality87 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by jhao104DetailsQuick view
9

Newspaper

VERIFIEDEXCELLENT · 100TRUST · 90SAFE · REVIEWEDCODING

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

$ npx skills add codelucas/newspaper
15.1K stars69 quality90 trustReviewed2mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

pythoncrawler
by codelucasDetailsQuick view
10

Scrapegraph AI

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDRESEARCH

Python scraper based on AI

$ npx skills add ScrapeGraphAI/Scrapegraph-ai
1 agent calls100% success27.2K stars76 quality88 trustReviewed2mo since pushSafe to try

Scenario Document processing

CLI + Codex · 4 targets

pythonweb-automation
by ScrapeGraphAIDetailsQuick view
11

Scrapy

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDCODING

Scrapy, a fast high-level web crawling & scraping framework for Python.

$ npx skills add scrapy/scrapy
62.5K stars74 quality88 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

pythonweb-automation
by scrapyDetailsQuick view
12

Trafilatura

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDRESEARCH

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

$ npx skills add adbar/trafilatura
6.4K stars68 quality88 trustReviewed with permission notes18d since pushSafe to try

Scenario Document processing

CLI + Codex · 4 targets

pythonweb-automation
by adbarDetailsQuick view
13

EasySpider

VERIFIEDEXCELLENT · 100TRUST · 89SAFE · REVIEWEDCODING

A visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/网页爬虫软件,可以无代码图形化的设计和执行爬虫任务。别名:ServiceWrapper面向Web应用的智能化服务封装系统。

$ npx skills add NaiboWang/EasySpider
44.1K stars73 quality89 trustReviewed3mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

javascriptcrawler
by NaiboWangDetailsQuick view
14

Helium

VERIFIEDEXCELLENT · 99TRUST · 85SAFE · REVIEWEDCODING

Lighter web automation with Python

$ npx skills add mherrmann/helium
8.3K stars66 quality85 trustReviewedBrowser agents3mo since pushSafe to try

Scenario Testing and QA

Browser agents + CLI · 4 targets

pythonweb-automation
by mherrmannDetailsQuick view
15

Scrapling

VERIFIEDEXCELLENT · 100TRUST · 83SAFE · REVIEWEDCODING

Adaptive web scraping for agent data collection

$ npx skills add D4Vinci/Scrapling
70.0K stars74 quality83 trustReviewed with permission notesBrowser agents1mo since pushNeeds review

Scenario Testing and QA

Browser agents + CLI · 4 targets

pythonweb-automationrag
by D4VinciDetailsQuick view
16

Crawl4AI

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDRESEARCH

Web crawling built for AI

$ npx skills add unclecode/crawl4ai
4 agent calls100% success73.1K stars77 quality88 trustReviewedClaude Code + OpenAI Agents1mo since pushSafe to try

Scenario Research agents

Claude Code + OpenAI Agents · 4 targets

claudegpt-4langchaincrewaiopenclaw
by unclecodeDetailsQuick view

Page 1

Showing the strongest 16 results to keep the registry fast for humans and agents. Refine by use case, platform, stars, or search query for a narrower shortlist.

Try the agent resolve API