1
Low latency web data collector
$ npx skills add spider-rs/spider2.5K stars65 qualityClaude Code
High-confidence pick with strong adoption and healthy maintenance signals.
rustai-agents
by spider-rsQuick view
Decision filters
Choose skills by scenario, quality, and trust signals.
8 skills matching "web-crawler"
Best blend of quality, stars, freshness, and agent usage
2
The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.
$ npx skills add microlinkhq/browserless1.8K stars65 qualityClaude Code + Browser agents
High-confidence pick with strong adoption and healthy maintenance signals.
javascriptbrowser-automation
by microlinkhqQuick view
3
一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
$ npx skills add shengqiangzhang/examples-of-web-crawlers14.6K stars61 qualityClaude Code + Browser agents
High-confidence pick with strong adoption and healthy maintenance signals.
htmlcrawler
by shengqiangzhangQuick view
4
新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
$ npx skills add ssssssss-team/spider-flow11.3K stars57 qualityClaude Code
Solid option that is likely worth shortlisting for production workflows.Check: Repository looks stale
javacrawler
by ssssssss-teamQuick view
5
A collection of awesome web crawler,spider in different languages
$ npx skills add BruceDone/awesome-crawler7.2K stars54 qualityClaude Code
Solid option that is likely worth shortlisting for production workflows.Check: Repository looks stale
crawler
by BruceDoneQuick view
6
简单易用的Python爬虫框架，QQ交流群：597510560
$ npx skills add xianhu/PSpider1.8K stars50 qualityClaude Code
Useful candidate, but compare it with alternatives before adopting.Check: Repository looks stale
pythoncrawler
by xianhuQuick view
7
Spidr
STRONG · 77A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
$ npx skills add postmodern/spidr835 stars47 qualityClaude Code
Solid option that is likely worth shortlisting for production workflows.
rubyweb-automation
by postmodernQuick view
8
Uscrapper
PROMISING · 55Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and analysis with Vanta's advanced capabilities. Fast, reliable, and user-friendly, Uscrapper Vanta is the ultimate choice for researchers and analysts.
$ npx skills add z0m31en7/Uscrapper778 stars39 qualityClaude Code
Useful candidate, but compare it with alternatives before adopting.Check: Repository looks stale
pythonweb-automation
by z0m31en7Quick view