#1
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
837 starsJan 12, 2026 pushweb-automationRubyCrawler
$ npx skills add postmodern/spidrAlternatives
Kimuraframework alternatives for AI agents.
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Kimuraframework
Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI to figure out where the data lives, then caches the selectors and scrapes with pure Ruby. Get the intelligence of an LLM without the per-request latency or token costs.
92
Quality
86
Trust
1.1K
Stars
#2
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
1.4K starsApr 7, 2026 pushweb-automationRubyCrawler
$ npx skills add felipecsl/wombat#3
Elegant Scraper and Crawler Framework for Golang
25K starsMay 25, 2026 pushweb-automationGoCrawler
$ npx skills add gocolly/colly#4
👾 Fast and simple video download library and CLI tool written in Go
31K starsMar 29, 2026 pushweb-automationGoCrawler
$ npx skills add iawia002/lux#5
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
15K starsMay 13, 2026 pushweb-automationPythonCrawler
$ npx skills add codelucas/newspaper#6
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
12K starsFeb 10, 2026 pushweb-automationGoCrawler
$ npx skills add crawlab-team/crawlab#7
Redis-based components for Scrapy.
5.6K starsMay 19, 2026 pushweb-automationPythonCrawler
$ npx skills add rmax/scrapy-redis#8
HTTP API for Scrapy spiders
880 starsMar 20, 2026 pushweb-automationPythonCrawler
$ npx skills add scrapinghub/scrapyrt#9
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度
3.7K starsJun 1, 2026 pushweb-automationPythonCrawler
$ npx skills add Boris-code/feapder#10
NewPipe's core library for extracting data from streaming sites
1.9K starsJun 13, 2026 pushweb-automationJavaCrawler
$ npx skills add TeamNewPipe/NewPipeExtractor#11
Node.js scraper to get data from Google Play
2.9K starsMay 31, 2026 pushweb-automationJavaScriptCrawler
$ npx skills add facundoolano/google-play-scraper#12
基于搜狗微信搜索的微信公众号爬虫接口
6.3K starsMar 7, 2026 pushweb-automationPythonCrawler
$ npx skills add chyroc/WechatSogou#13
:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
2.7K starsJun 10, 2026 pushweb-automationPHPCrawler
$ npx skills add jae-jae/QueryList#14
To extract main article from given URL with Node.js
1.9K starsMay 3, 2026 pushweb-automationJavaScriptCrawler
$ npx skills add extractus/article-extractor#15
📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
1.1K starsApr 30, 2026 pushweb-automationPythonCrawler
$ npx skills add AndyTheFactory/newspaper4k#16
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
44K starsMay 22, 2026 pushweb-automationJavaScriptCrawler
$ npx skills add NaiboWang/EasySpiderHow to choose
When should you switch?
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Kimuraframework if it already passes your workflow test and repository review.
Next step
Compare top candidates side by side
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.