Scrapy
scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
OPENAGENTSKILL / DIRECTORY
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
65–80 / 233
Candidates in this shortlist, not the full registry. GitHub stars belong to repositories, not individual skills.
Results: 233
scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
huginn
Create agents that monitor and act on your behalf. Your agents are standing by!
NaiboWang
A visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/网页爬虫软件,可以无代码图形化的设计和执行爬虫任务。别名:ServiceWrapper面向Web应用的智能化服务封装系统。
trycua
Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full desktops (macOS, Linux, Windows…
dgtlmoon
Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, a…
any4ai
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading…
browser-use
Browser Harness | Self-healing harness that enables LLMs to complete any task.
steel-dev
🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructu…
jo-inc
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
keon
A tiny, fast Rust CLI that drives a real browser over the Chrome DevTools Protocol — built for coding agents.
OnionBrowser
An open-source, privacy-enhancing web browser for iOS, utilizing the Tor anonymity network