AI Agent Skills

Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

wxpath - declarative web crawling with XPath; a Web Query Language (WQL)

Analyzes and generates llms.txt files -- the emerging standard for helping AI systems understand website structure and content. Can validate existing llms.txt files or g…

Build and query an evidence-lined GEO knowledge graph from approved source bundles. Use for entity normalization, relation lineage, conflicting fact preservation, increm…