Crawl4AI
VERIFIED
Web crawling built for AI
Downloads 31.0K
Stars 42.0K
Used by 18.0K agents
Rating 4.9/5
Version 0.4.0
Install with one command
$ npx skills add unclecode/crawl4aiOverview
Crawl4AI is an open-source web crawling framework designed specifically for AI agents. It extracts clean, structured data from websites in LLM-friendly formats like markdown. Supports JavaScript rendering, session management, and proxy rotation.
Platform Compatibility
claudeFULL
gpt-4FULL
langchainFULL
crewaiFULL
openclawFULL
Technical Details
- Version
- 0.4.0
- License
- Apache-2.0
- Last Updated
- 2/21/2026
- Published
- 2/21/2026
Frameworks & Tools
ClaudeGPT-4LangChainCrewAIOpenClaw
Author
U
unclecode✓
@unclecode
Trust & Safety
- —Open source (public GitHub repo)
- —AI static analysis passed
- —License: Apache-2.0
- —Manually verified by team