Crawler
crwlrsoft
Library for Rapid (Web) Crawler and Scraper Development
OPENAGENTSKILL / DIRECTORY
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Find a skill for your next task. Preview examples where available.
1–16 / 18
Results: 18
crwlrsoft
Library for Rapid (Web) Crawler and Scraper Development
webrecorder
Run a high-fidelity browser-based web archiving crawler in a single Docker container
yujiosaka
Distributed crawler powered by Headless Chrome
Qianlitp
A powerful browser crawler for web vulnerability scanners
superryeti
This email crawler will visit all pages of a provided website and parse and save emails found to a csv file.
oxylabs
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM…
s0rg
The unix-way web crawler
VIDA-NYU
ACHE is a web crawler for domain-specific search.
oxylabs
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM…
coder-hxl
Flexible Node.js AI-assisted crawler library
flairNLP
A very simple news crawler with a funny name
myvyang
dynamic crawler for web vulnerability scanner
duckduckgo
🕸 Modular, multithreaded, puppeteer-based crawler
N0taN3rd
Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head
openai
Automate a real browser from the terminal for navigation, form filling, snapshots, screenshots, extraction, and UI-flow debugging.
browser-use
Browser automation layer for agents that need to interact with websites.