AI Agent Skills

A high performance web crawler / scraper in Elixir.

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

A collection of awesome web crawler,spider in different languages

Google, Naver multiprocess image web crawler (Selenium)

A scalable, mature and versatile web crawler based on Apache Storm

A lightweight web crawler framework.（Java爬虫框架）

Elasticsearch File System Crawler (FS Crawler)

Run a high-fidelity browser-based web archiving crawler in a single Docker container

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineer…

A multi-thread crawler framework with many builtin image crawlers provided.

zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目

Distributed crawler powered by Headless Chrome

新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频

Download comics novels 小说漫画下载工具 小説漫画のダウンローダ 小說漫畫下載:腾讯漫画 大角虫漫画 有妖气 咪咕 SF漫画 哦漫画 看漫画 漫画柜 汗汗酷漫 動漫伊甸園 快看漫画 微博动漫 733动漫网 大古漫画网 漫画DB 無限動漫 動漫狂 卡推漫画 动漫之家 动漫屋 古风漫画网 36漫画网 亲亲漫画网 乙女漫…

Easily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片，视频