Collect structured data
Scrape competitor pricing pages
Find skills for crawling public pricing pages, extracting plan names, prices, feature tables, and producing markdown or JSON for downstream analysis.
Agent prompt
Find the best skill for scraping public competitor pricing pages, extracting structured pricing tables, and returning clean markdown or JSON.
Best first install
Scrapegraph AI
Python scraper based on AI
Install with one command
$ npx skills add ScrapeGraphAI/Scrapegraph-aiInstall targets
Install this skill in your agent workflow
Copy the registry command or an agent-specific install prompt for Codex, Claude Code, and Cursor.
OpenAgentSkill CLI
Use the registry command when your workflow supports the OpenAgentSkill installer.
$ npx skills add ScrapeGraphAI/Scrapegraph-aiDecision guide
Use and avoid conditions
Success criteria
- Returns structured pricing fields
- Handles ordinary public webpages
- Can be tested against a sample URL
Do not use when
- The site requires login or payment
- Robots or terms prohibit automated crawling
- The task needs human-only judgment
Alternatives
Compare before installing
Crawl4AI
904Open-source LLM-friendly web crawler and scraper
Firecrawl
878Turn any website into LLM-ready markdown or structured data
Awesome Web Scraping
864List of libraries, tools and APIs for web scraping and data processing.
Trafilatura
852Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
JMComic Crawler Python
829Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀
Node Crawler
825Web Crawler/Spider for NodeJS + server-side jQuery ;-)