OpenAgentSkill Registry Manifest
Skill: Crawler
Slug: norconex-crawler
Category: rag-knowledge
Description: Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or filesystem to various data repositories such as search engines.

Agent fit:
- Decision: 79/100 Strong shortlist
- Primary fit: RAG and knowledge
- Role: Companion skill

Supply profile:
- Track: Research and knowledge work
- Scenario: RAG and knowledge
- Applicable agents: Claude Code, CLI, Codex, Cursor, Java
- Maintenance: 7d since push
- Risk: Safe to try

Trust:
- Trust score: 80/100 Strong shortlist
- Audit: 85/100 Safe to try

Attribution:
- Status: Community indexed
- Source: GitHub star discovery
- Creator: Norconex
- Claim URL: https://www.openagentskill.com/skills/norconex-crawler#claim-this-skill

Install:
npx skills add Norconex/crawler

URLs:
- Web: https://www.openagentskill.com/skills/norconex-crawler
- API: https://www.openagentskill.com/api/agent/skills/norconex-crawler
- Install API: https://www.openagentskill.com/api/skills/norconex-crawler/install
- Repository: https://github.com/Norconex/crawler