AI Agent Skill Repository

AI Agent Skills Directory

Browse reusable skills for Codex, Claude Code, Cursor, finance, research, web scraping, PPT, football analytics, data, marketing, design, and more.

Live registry search

Results for “markdown-crawler

Exact name and slug matches are checked against the live registry before ranked alternatives.

Clear search

Decision filters

Choose by scenario, quality, and trust signals.

Showing 1-16 of 230 ranked candidates matching "markdown-crawler"

Best blend of relevance, quality, freshness, and verified outcomes

1

Node Crawler

VERIFIEDEXCELLENT · 98TRUST · 87SAFE · REVIEWEDRESEARCH

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

$ npx skills add bda-research/node-crawler
6.8K stars66 quality87 trustReviewed2mo since pushSafe to try

Scenario Research agents

CLI + Codex · 4 targets

typescriptcrawler
by bda-researchDetailsQuick view
2

Crawler Illegal Cases In China

VERIFIEDEXCELLENT · 87TRUST · 83SAFE · REVIEWEDCODING

Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律,避免触碰数据合规红线。

$ npx skills add hiddendevj/Crawler_Illegal_Cases_In_China
4.6K stars60 quality83 trustReviewed5mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

htmlcrawler
by hiddendevjDetailsQuick view
3

JMComic Crawler Python

VERIFIEDEXCELLENT · 98TRUST · 88SAFE · REVIEWEDCODING

Python API for JMComic | 提供Python API访问禁漫天堂,同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀

$ npx skills add hect0x7/JMComic-Crawler-Python
6.5K stars65 quality88 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

pythoncrawler
by hect0x7DetailsQuick view
4

Crawler

VERIFIEDEXCELLENT · 94TRUST · 86SAFE · REVIEWEDCODING

https://spatie.be/docs/crawler

$ npx skills add spatie/crawler
2.8K stars63 quality86 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

phpcrawler
by spatieDetailsQuick view
5

Crawler Detect

VERIFIEDEXCELLENT · 93TRUST · 88SAFE · REVIEWEDCODING

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

$ npx skills add JayBizzle/Crawler-Detect
2.4K stars62 quality88 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

phpcrawler
by JayBizzleDetailsQuick view
6

Fscrawler

VERIFIEDEXCELLENT · 91TRUST · 85SAFE · REVIEWEDCODING

Elasticsearch File System Crawler (FS Crawler)

$ npx skills add dadoonet/fscrawler
1.4K stars61 quality85 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

javacrawler
by dadoonetDetailsQuick view
7

Browsertrix Crawler

VERIFIEDEXCELLENT · 96TRUST · 86SAFE · REVIEWEDCODING

Run a high-fidelity browser-based web archiving crawler in a single Docker container

$ npx skills add webrecorder/browsertrix-crawler
1.1K stars63 quality86 trustReviewedBrowser agents30d since pushSafe to try

Scenario GitHub automation

Browser agents + CLI · 4 targets

typescriptcrawler
by webrecorderDetailsQuick view
8

Scrapegraph AI

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDRESEARCH

Python scraper based on AI

$ npx skills add ScrapeGraphAI/Scrapegraph-ai
1 agent calls100% success27.2K stars76 quality88 trustReviewed2mo since pushSafe to try

Scenario Document processing

CLI + Codex · 4 targets

pythonweb-automation
by ScrapeGraphAIDetailsQuick view
9

MediaCrawler

EXCELLENT · 100TRUST · 84SAFE · REVIEWEDCODING

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 知乎问答文章 | 评论爬虫。支持多平台社交媒体内容抓取,提供完整的数据采集解决方案。

$ npx skills add NanmiCoder/MediaCrawler
1 agent calls100% success56.9K stars68 quality84 trustReviewed1mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

python
by NanmiCoderDetailsQuick view
10

EasySpider

VERIFIEDEXCELLENT · 100TRUST · 89SAFE · REVIEWEDCODING

A visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/网页爬虫软件,可以无代码图形化的设计和执行爬虫任务。别名:ServiceWrapper面向Web应用的智能化服务封装系统。

$ npx skills add NaiboWang/EasySpider
44.1K stars73 quality89 trustReviewed3mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

javascriptcrawler
by NaiboWangDetailsQuick view
11

Crawlab

VERIFIEDEXCELLENT · 90TRUST · 86SAFE · REVIEWEDWORLD CUP

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架

$ npx skills add crawlab-team/crawlab
12.2K stars61 quality86 trustReviewed6mo since pushSafe to try

Scenario Sports analytics

CLI + Codex · 4 targets

gocrawler
by crawlab-teamDetailsQuick view
12

Webmagic

VERIFIEDEXCELLENT · 90TRUST · 85SAFE · REVIEWEDCODING

A scalable web crawler framework for Java.

$ npx skills add code4craft/webmagic
11.7K stars61 quality85 trustReviewed8mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

javacrawler
by code4craftDetailsQuick view
13

AnyCrawl

VERIFIEDEXCELLENT · 94TRUST · 86SAFE · REVIEWEDDATA

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading…

$ npx skills add any4ai/AnyCrawl
3.2K stars63 quality86 trustReviewed2mo since pushSafe to try

Scenario Web scraping

CLI + Codex · 4 targets

mdxrag
by any4aiDetailsQuick view
14

Firecrawl

VERIFIEDEXCELLENT · 100TRUST · 87SAFE · REVIEWEDRESEARCH

Web data for AI applications

$ npx skills add firecrawl/firecrawl
134.2K stars73 quality87 trustReviewedClaude Code + OpenAI Agents2mo since pushSafe to try

Scenario Document processing

Claude Code + OpenAI Agents · 4 targets

claudegpt-4langchainopenclaw
by mendableaiDetailsQuick view
15

Crawl4AI

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDRESEARCH

Web crawling built for AI

$ npx skills add unclecode/crawl4ai
4 agent calls100% success73.1K stars77 quality88 trustReviewedClaude Code + OpenAI Agents1mo since pushSafe to try

Scenario Research agents

Claude Code + OpenAI Agents · 4 targets

claudegpt-4langchaincrewaiopenclaw
by unclecodeDetailsQuick view
16

Colly

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDCODING

Elegant Scraper and Crawler Framework for Golang

$ npx skills add gocolly/colly
25.3K stars71 quality88 trustReviewed2mo since pushSafe to try

Scenario GitHub automation

CLI + Codex · 4 targets

gocrawler
by gocollyDetailsQuick view

Page 1

Showing the strongest 16 results to keep the registry fast for humans and agents. Refine by use case, platform, stars, or search query for a narrower shortlist.

Try the agent resolve API