Crawler
fredwu
A high performance web crawler / scraper in Elixir.
958GitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Find a skill for your next task. Preview examples where available.
Results · “crawler”
1–16 / 96
Results: 96
Node Crawler
bda-research
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
6.8KGitHub
Awesome Crawler
BruceDone
A collection of awesome web crawler,spider in different languages
7.2KGitHub
AutoCrawler
YoongiKim
Google, Naver multiprocess image web crawler (Selenium)
1.7KGitHub
Stormcrawler
apache
A scalable, mature and versatile web crawler based on Apache Storm
995GitHub
Xxl Crawler
xuxueli
A lightweight web crawler framework.（Java爬虫框架）
756GitHub
Fscrawler
dadoonet
Elasticsearch File System Crawler (FS Crawler)
1.4KGitHub
Browsertrix Crawler
webrecorder
Run a high-fidelity browser-based web archiving crawler in a single Docker container
1.1KGitHub
Markdown Crawler
paulpierre
A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG
450GitHub
Siteone Crawler
janreges
SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineer…
770GitHub
Icrawler
hellock
A multi-thread crawler framework with many builtin image crawlers provided.
930GitHub
Zhihu Crawler
wycm
zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目
920GitHub
Headless Chrome Crawler
yujiosaka
Distributed crawler powered by Headless Chrome
5.6KGitHub
Weibo Crawler
dataabc
新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频
4.5KGitHub
Work Crawler
kanasimi
Download comics novels 小说漫画下载工具 小説漫画のダウンローダ 小說漫畫下載:腾讯漫画 大角虫漫画 有妖气 咪咕 SF漫画 哦漫画 看漫画 漫画柜 汗汗酷漫 動漫伊甸園 快看漫画 微博动漫 733动漫网 大古漫画网 漫画DB 無限動漫 動漫狂 卡推漫画 动漫之家 动漫屋 古风漫画网 36漫画网 亲亲漫画网 乙女漫…
4.1KGitHub
Tumblr Crawler
dixudx
Easily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片，视频
1.2KGitHub