Collect structured data
Crawl a documentation site
Find skills for crawling docs, converting HTML to markdown, preserving links, and preparing agent-ready source material.
Agent prompt
Find the best skill for crawling a documentation website and converting pages into clean markdown with useful metadata.
Best first install
Html To Markdown
⚙️ Convert HTML to Markdown. Even works with entire websites and can be extended through rules.
Install with one command
$ npx skills add JohannesKaufmann/html-to-markdownInstall targets
Install this skill in your agent workflow
Copy the registry command or an agent-specific install prompt for Codex, Claude Code, and Cursor.
OpenAgentSkill CLI
Use the registry command when your workflow supports the OpenAgentSkill installer.
$ npx skills add JohannesKaufmann/html-to-markdownDecision guide
Use and avoid conditions
Success criteria
- Preserves source URLs
- Produces clean markdown
- Can limit crawl scope
Do not use when
- Docs block crawling
- The content is private without authorization
- You need pixel-perfect browser state
Alternatives
Compare before installing
Docsify
899🃏 A magical documentation site generator.
AnyCrawl
893AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
Mkdocs
871Project documentation with Markdown.
Hugo Book
858Hugo documentation theme as simple as plain book
Cloudflare Docs
836Cloudflare’s documentation
Pandoc
836Universal markup converter