AI Agent Skill Repository

AI Agent Skills Directory

Browse reusable skills for Codex, Claude Code, Cursor, finance, research, web scraping, PPT, football analytics, data, marketing, design, and more.

Live registry search

Results for “llm-crawler

Exact name and slug matches are checked against the live registry before ranked alternatives.

Clear search

Decision filters

Choose by scenario, quality, and trust signals.

Showing 1-16 of 174 ranked candidates matching "llm-crawler"

Best blend of relevance, quality, freshness, and verified outcomes

1

Node Crawler

VERIFIEDEXCELLENT · 98TRUST · 87SAFE · REVIEWEDRESEARCH

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

$ npx skills add bda-research/node-crawler
6.8K stars66 quality87 trustReviewed2mo since pushSafe to try

Scenario Research agents

CLI + Codex · 4 targets

typescriptcrawler
by bda-researchDetailsQuick view
2

Llm Scraper

VERIFIEDEXCELLENT · 98TRUST · 85SAFE · REVIEWEDCODING

Turn any webpage into structured data using LLMs

$ npx skills add mishushakov/llm-scraper
6.8K stars66 quality85 trustReviewedOpenAI Agents + LangChain2mo since pushSafe to try

Scenario Testing and QA

OpenAI Agents + LangChain · 4 targets

typescriptbrowser-automation
by mishushakovDetailsQuick view
3

WaterCrawl

VERIFIEDEXCELLENT · 87TRUST · 81SAFE · REVIEWEDMARKETING

Transform Web Content into LLM-Ready Data

$ npx skills add watercrawl/WaterCrawl
2.0K stars62 quality81 trustReviewed with permission notes3mo since pushNeeds review

Scenario Content automation

CLI + Codex · 4 targets

typescriptcrawler
by watercrawlDetailsQuick view
4

JMComic Crawler Python

VERIFIEDEXCELLENT · 98TRUST · 88SAFE · REVIEWEDCODING

Python API for JMComic | 提供Python API访问禁漫天堂,同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀

$ npx skills add hect0x7/JMComic-Crawler-Python
6.5K stars65 quality88 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by hect0x7DetailsQuick view
5

Crawler

VERIFIEDEXCELLENT · 94TRUST · 86SAFE · REVIEWEDCODING

https://spatie.be/docs/crawler

$ npx skills add spatie/crawler
2.8K stars63 quality86 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

phpcrawler
by spatieDetailsQuick view
6

Crawler Detect

VERIFIEDEXCELLENT · 93TRUST · 88SAFE · REVIEWEDCODING

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

$ npx skills add JayBizzle/Crawler-Detect
2.4K stars62 quality88 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

phpcrawler
by JayBizzleDetailsQuick view
7

Browsertrix Crawler

VERIFIEDEXCELLENT · 96TRUST · 86SAFE · REVIEWEDCODING

Run a high-fidelity browser-based web archiving crawler in a single Docker container

$ npx skills add webrecorder/browsertrix-crawler
1.1K stars63 quality86 trustReviewedBrowser agents29d since pushSafe to try

Scenario GitHub automation

Browser agents + CLI · 4 targets

typescriptcrawler
by webrecorderDetailsQuick view
8

Scrapegraph AI

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDRESEARCH

Python scraper based on AI

$ npx skills add ScrapeGraphAI/Scrapegraph-ai
1 agent calls100% success27.2K stars76 quality88 trustReviewed2mo since pushSafe to try

Scenario Document processing

CLI + Codex · 4 targets

pythonweb-automation
by ScrapeGraphAIDetailsQuick view
9

Crawl4AI

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDRESEARCH

Web crawling built for AI

$ npx skills add unclecode/crawl4ai
4 agent calls100% success73.1K stars77 quality88 trustReviewedClaude Code + OpenAI Agents1mo since pushSafe to try

Scenario Research agents

Claude Code + OpenAI Agents · 4 targets

claudegpt-4langchaincrewaiopenclaw
by unclecodeDetailsQuick view
10

MediaCrawler

EXCELLENT · 100TRUST · 84SAFE · REVIEWEDCODING

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 知乎问答文章 | 评论爬虫。支持多平台社交媒体内容抓取,提供完整的数据采集解决方案。

$ npx skills add NanmiCoder/MediaCrawler
1 agent calls100% success56.9K stars68 quality84 trustReviewed1mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

python
by NanmiCoderDetailsQuick view
11

EasySpider

VERIFIEDEXCELLENT · 100TRUST · 89SAFE · REVIEWEDCODING

A visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/网页爬虫软件,可以无代码图形化的设计和执行爬虫任务。别名:ServiceWrapper面向Web应用的智能化服务封装系统。

$ npx skills add NaiboWang/EasySpider
44.1K stars73 quality89 trustReviewed3mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

javascriptcrawler
by NaiboWangDetailsQuick view
12

Sparrow

VERIFIEDEXCELLENT · 97TRUST · 87SAFE · REVIEWEDRESEARCH

Structured data extraction and instruction calling with ML, LLM and Vision LLM

$ npx skills add katanaml/sparrow
5.2K stars65 quality87 trustReviewedOpenAI Agents2mo since pushSafe to try

Scenario RAG and knowledge

OpenAI Agents + CLI · 4 targets

pythonrag
by katanamlDetailsQuick view
13

Colly

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDCODING

Elegant Scraper and Crawler Framework for Golang

$ npx skills add gocolly/colly
25.3K stars71 quality88 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

gocrawler
by gocollyDetailsQuick view
14

Feapder

VERIFIEDEXCELLENT · 90TRUST · 84SAFE · REVIEWEDCODING

🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单,功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量…

$ npx skills add Boris-code/feapder
3.7K stars64 quality84 trustReviewed3mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

pythoncrawler
by Boris-codeDetailsQuick view
15

QueryList

VERIFIEDEXCELLENT · 89TRUST · 82SAFE · REVIEWEDCODING

:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

$ npx skills add jae-jae/QueryList
2.7K stars63 quality82 trustReviewed with permission notes2mo since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

phpcrawler
by jae-jaeDetailsQuick view
16

AnyCrawl

VERIFIEDEXCELLENT · 94TRUST · 86SAFE · REVIEWEDDATA

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading…

$ npx skills add any4ai/AnyCrawl
3.2K stars63 quality86 trustReviewed2mo since pushSafe to try

Scenario Web scraping

CLI + Codex · 4 targets

mdxrag
by any4aiDetailsQuick view

Page 1

Showing the strongest 16 results to keep the registry fast for humans and agents. Refine by use case, platform, stars, or search query for a narrower shortlist.

Try the agent resolve API