Siteone Crawler
janreges
SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineer…
Web ScrapingSkill source unconfirmed
770GitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Results · “movie-crawler”
17–32 / 218
More filters
Candidates in this shortlist, not the full registry. GitHub stars belong to repositories, not individual skills.
Results: 218
Icrawler
hellock
A multi-thread crawler framework with many builtin image crawlers provided.
Web ScrapingSkill source unconfirmed
930GitHub
MediaCrawler
NanmiCoder
小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 知乎问答文章 | 评论爬虫。支持多平台社交媒体内容抓取，提供完整的数据采集解决方案。
DataSkill source unconfirmed
56.9KGitHub
920GitHub
EasySpider
NaiboWang
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
Web ScrapingSkill source unconfirmed
44.1KGitHub
5.6KGitHub
Crawlab
crawlab-team
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
Web ScrapingSkill source unconfirmed
12.2KGitHub
11.7KGitHub
News Please
fhamborg
news-please - an integrated web crawler and information extractor for news that just works
Web ScrapingSkill source unconfirmed
2.5KGitHub
2.5KGitHub
Abot
sjdirect
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
Web ScrapingSkill source unconfirmed
2.3KGitHub
2.1KGitHub
Grab Site
ArchiveTeam
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Web ScrapingSkill source unconfirmed
1.6KGitHub
27.2KGitHub
Fetchbot
PuerkitoBio
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
Web ScrapingSkill source unconfirmed
791GitHub
624GitHub