Browser & automation
Crawl4AI
Open-source LLM-friendly web crawler and scraper
unclecode · AI review on file
Installation
Read the source and dependencies before running a command. Copying does not install or execute anything.
npx skills add unclecode/crawl4aiAbout this skill
Crawl4AI is an open-source web crawling framework designed specifically for AI agents. It extracts clean, structured data from websites in LLM-friendly formats like markdown. Supports JavaScript rendering, session management, and proxy rotation.