Spidr
postmodern
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
836GitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Find a skill for your next task. Preview examples where available.
Results · “spider”
17–19 / 19
Results: 19
Freshonions Torscraper
dirtyfilthy
Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion
535GitHub
Crawler
infinilabs
🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)
312GitHub