AI & knowledge
Craw4LLM
Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"
cxcscmu · AI review on file
Installation
Read the source and dependencies before running a command. Copying does not install or execute anything.
npx skills add cxcscmu/Craw4LLMAbout this skill
Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"
Imported by the skill-only GitHub discovery pipeline because it matches agent skill, automation, RAG, or developer-tool signals. Protocol-server projects are excluded from automated imports.