QueryList
jae-jae
:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
2.7KGitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Find a skill for your next task. Preview examples where available.
Results · “crawler”
49–64 / 81
Results: 81
Go Spider
hu17889
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you ca…
1.8KGitHub
Crawley
s0rg
The unix-way web crawler
341GitHub
Ache
VIDA-NYU
ACHE is a web crawler for domain-specific search.
483GitHub
Oxylabs AI Studio Js
oxylabs
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM…
143GitHub
Krawl
BlessedRebuS
Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realis…
546GitHub
Fbcrawl
rugantio
688GitHub
Freshonions Torscraper
dirtyfilthy
Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion
535GitHub
Scavenger
rndinfosecguy
Crawler (Bot) searching for credential leaks on paste sites.
810GitHub
Creeper
wspl
:paw_prints: Creeper - The Next Generation Crawler Framework (Go)
778GitHub
Photon
s0md3v
Incredibly fast crawler designed for OSINT.
12.9KGitHub
Scan T
nanshihui
a new crawler based on python with more function including Network fingerprint search
502GitHub
X Crawl
coder-hxl
Flexible Node.js AI-assisted crawler library
1.9KGitHub
Weibospider
SpiderClub
:zap: A distributed crawler for weibo, building with celery and requests.
4.8KGitHub
Firecrawl
mendableai
Turn websites into clean markdown or structured data for retrieval and agents.
34KGitHub
Clipper.Js
philschmid
HTML to Markdown converter and crawler.
620GitHub