Craw4LLM
cxcscmu
Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"
653GitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Find a skill for your next task. Preview examples where available.
Results · “crawling”
1–4 / 4
Results: 4
Wxpath
rodricios
wxpath - declarative web crawling with XPath; a Web Query Language (WQL)
112GitHub
geo-llmstxt
zubair-trabzada
Analyzes and generates llms.txt files -- the emerging standard for helping AI systems understand website structure and content. Can validate existing llms.txt files or g…
10.1KGitHub
geo-knowledge
yaojingang
Build and query an evidence-lined GEO knowledge graph from approved source bundles. Use for entity normalization, relation lineage, conflicting fact preservation, increm…
152GitHub