{"query":"Crawler","filters":{"category":null,"platform":null,"track":null,"safety":null,"include_blocked":false,"min_stars":0},"total":10,"skills":[{"rank":1,"match_score":283.9,"slug":"naibowang-easyspider","name":"EasySpider","description":"A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。","tagline":"A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。","category":"web-automation","tags":["crawler","data-extraction","batch-processing","batch-script","code-free","data-collection","frontend","gui","html","input-parameters"],"author":{"name":"NaiboWang","verified":true,"url":"https://github.com/NaiboWang"},"attribution":{"status":"community_indexed","statusLabel":"Community indexed","shortLabel":"COMMUNITY INDEXED","sourceLabel":"GitHub star discovery","sourceDetail":"NaiboWang/EasySpider","creatorName":"NaiboWang","creatorUrl":"https://github.com/NaiboWang","sourceUrl":"https://github.com/NaiboWang/EasySpider","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/naibowang-easyspider#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":44024,"forks":5356,"downloads":0,"rating":0,"review_count":0,"quality_score":75.71},"quality":{"score":100,"tier":"excellent","label":"Excellent","summary":"High-confidence pick with strong adoption and healthy maintenance signals.","signals":[{"label":"GitHub stars","value":"44K","tone":"positive"},{"label":"Freshness","value":"25d ago","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"AGPL-3.0","tone":"neutral"}],"warnings":[]},"trust":{"version":"trust-score-v3","score":99,"tier":"production","label":"Production candidate","summary":"Strong OpenAgentSkill Trust Score across adoption, recent maintenance, license clarity, documentation, dependency/runtime risk, install safety, permission surface, and install availability.","recommendedAction":"Shortlist for production use, then run a normal repository and dependency review.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":100,"weight":0.13,"status":"pass","detail":"44K GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":100,"weight":0.08,"status":"pass","detail":"44K stars, 5.4K forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"25d since push"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"AGPL-3.0"},{"id":"documentation","label":"README/SKILL.md completeness","score":90,"weight":0.14,"status":"pass","detail":"Metadata includes enough usage and workflow context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":90,"weight":0.12,"status":"pass","detail":"no major dependency risk hints in public metadata"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add NaiboWang/EasySpider"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":100,"weight":0.07,"status":"pass","detail":"no high-risk permission surface in public metadata"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/NaiboWang/EasySpider"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"}],"checks":[{"status":"pass","label":"GitHub adoption","detail":"44K GitHub stars"},{"status":"pass","label":"Stars/forks activity","detail":"44K stars, 5.4K forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"25d since push"},{"status":"pass","label":"License clarity","detail":"AGPL-3.0"},{"status":"pass","label":"README/SKILL.md completeness","detail":"Metadata includes enough usage and workflow context"},{"status":"pass","label":"Dependency/runtime risk","detail":"no major dependency risk hints in public metadata"},{"status":"pass","label":"Install availability","detail":"npx skills add NaiboWang/EasySpider"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"no high-risk permission surface in public metadata"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/NaiboWang/EasySpider"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"pass","label":"Ownership","detail":"Listing manually verified"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"}],"strengths":["Manually verified listing","AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Large GitHub adoption signal","Install command has no obvious high-risk pattern"],"warnings":[],"evidence":{"stars":"44K GitHub stars","repoActivity":"44K stars, 5.4K forks","lastPushed":"25d since push","license":"AGPL-3.0","repository":"https://github.com/NaiboWang/EasySpider","install":"npx skills add NaiboWang/EasySpider","installSafety":"standard package or runtime install path","permissionSurface":"no high-risk permission surface in public metadata","documentation":"Strong README/SKILL.md context"},"installReadiness":{"ready":true,"command":"npx skills add NaiboWang/EasySpider","policy":"agent_install_candidate","label":"Agent install candidate","notes":["Install path is available","Repository evidence is available","License is declared","25d since push"]},"agentCompatibility":["JavaScript","Crawler","Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"low","label":"Low metadata risk","notes":["No major trust warnings detected from available metadata"]}},"safety":{"score":93,"level":"safe_to_install","label":"Safe to install with normal review","safety_tier":{"tier":"verified","label":"Verified","badge":"VERIFIED","summary":"Strong metadata, audit, install, and review signals. Suitable for agent shortlists after normal workspace review.","recommended_action":"Allow agent install in a sandbox or low-risk workspace, then promote after one successful narrow task.","auto_install_policy":"allow","reasons":["Verified listing","Safe-to-try audit","93/100 agent safety score"]},"auto_install_allowed":true,"human_review_required":false,"blocked":false,"audit_risk":"safe_to_try","permission_hints":[{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"}],"policy_warnings":[],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"verified","label":"Verified","badge":"VERIFIED","auto_install_policy":"allow","auto_install_allowed":true,"human_review_required":false,"blocked":false,"recommended_action":"Allow agent install in a sandbox or low-risk workspace, then promote after one successful narrow task.","reasons":["Verified listing","Safe-to-try audit","93/100 agent safety score"]},"supply_profile":{"track":{"slug":"coding","label":"Coding and developer agents","shortLabel":"Coding","description":"Code review, repo analysis, testing, CI, GitHub, DevOps, and developer workflow skills."},"scenario":{"label":"Coding agents","description":"I need a coding agent that can understand a repository, edit code, and review pull requests.","useCases":[{"slug":"web-scraping","title":"Web scraping"},{"slug":"coding-agents","title":"Coding agents"},{"slug":"local-desktop","title":"Local desktop"}]},"applicableAgents":["Claude Code","CLI","Codex","Cursor","JavaScript"],"install":{"ready":true,"command":"npx skills add NaiboWang/EasySpider","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":44024,"starsLabel":"44K","forks":5356,"license":"AGPL-3.0","qualityScore":100,"trustScore":99,"auditScore":97},"maintenance":{"status":"fresh","label":"25d since push","daysSincePush":25,"lastPushedAt":"2026-05-22T11:59:59+00:00"},"risk":{"level":"safe_to_try","label":"Safe to try","requiresReview":false,"notes":["No major risk signals from available metadata"]},"coverageTags":["Coding","Coding agents","web-automation","crawler","data-extraction","batch-processing","batch-script","code-free"]},"audit":{"audit_score":97,"risk_level":"safe_to_try","risk_label":"Safe to try","warnings":[]},"decision":{"readiness_score":100,"readiness_label":"Production-ready","headline":"Primary pick for Web scraping","role":"Primary pick","primary_fit":"Web scraping","best_for":["Web scraping workflows","Claude Code teams","teams that value GitHub adoption signals"],"risks":["No OpenAgentSkill engagement data yet"],"next_steps":["Install it in a sandbox agent and run one Web scraping task end to end.","Compare output quality, latency, and failure behavior against at least one alternative.","Promote it into production only after reviewing repository permissions, license, and maintenance signals."]},"platforms":["JavaScript","Crawler","Claude Code"],"use_cases":[{"slug":"web-scraping","title":"Web scraping","url":"https://www.openagentskill.com/use-cases/web-scraping"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"},{"slug":"local-desktop","title":"Local desktop","url":"https://www.openagentskill.com/use-cases/local-desktop"},{"slug":"browser-automation","title":"Browser automation","url":"https://www.openagentskill.com/use-cases/browser-automation"}],"install":"npx skills add NaiboWang/EasySpider","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx skills add NaiboWang/EasySpider","description":"Use the registry command when your workflow supports the OpenAgentSkill installer.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"EasySpider\" agent skill from https://github.com/NaiboWang/EasySpider. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"EasySpider\" as a Claude Code skill from https://github.com/NaiboWang/EasySpider. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"EasySpider\" from https://github.com/NaiboWang/EasySpider into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/NaiboWang/EasySpider","github_repo":"NaiboWang/EasySpider","version":"1.0.0","license":"AGPL-3.0","updated_at":"2026-06-14T03:04:23.508135+00:00","canonical_key":"naibowang/easyspider","recommendation_reasons":["Matches task terms: crawler","Strong GitHub adoption: 44,024 stars","Quality score 76/100","Install handoff is available","Repository freshness signal is available"],"urls":{"web":"https://www.openagentskill.com/skills/naibowang-easyspider","api":"https://www.openagentskill.com/api/agent/skills/naibowang-easyspider","install_api":"https://www.openagentskill.com/api/skills/naibowang-easyspider/install","audit":"https://www.openagentskill.com/skills/naibowang-easyspider/audit","repository":"https://github.com/NaiboWang/EasySpider"}},{"rank":2,"match_score":255.5,"slug":"gocolly-colly","name":"Colly","description":"Elegant Scraper and Crawler Framework for Golang","tagline":"Elegant Scraper and Crawler Framework for Golang","category":"web-automation","tags":["crawler","data-extraction","crawling","framework","go","golang","scraper","scraping","spider","github"],"author":{"name":"gocolly","verified":true,"url":"https://github.com/gocolly"},"attribution":{"status":"community_indexed","statusLabel":"Community indexed","shortLabel":"COMMUNITY INDEXED","sourceLabel":"GitHub star discovery","sourceDetail":"gocolly/colly","creatorName":"gocolly","creatorUrl":"https://github.com/gocolly","sourceUrl":"https://github.com/gocolly/colly","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/gocolly-colly#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":25331,"forks":1850,"downloads":0,"rating":0,"review_count":0,"quality_score":74.03},"quality":{"score":100,"tier":"excellent","label":"Excellent","summary":"High-confidence pick with strong adoption and healthy maintenance signals.","signals":[{"label":"GitHub stars","value":"25K","tone":"positive"},{"label":"Freshness","value":"22d ago","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"Apache-2.0","tone":"neutral"}],"warnings":[]},"trust":{"version":"trust-score-v3","score":96,"tier":"production","label":"Production candidate","summary":"Strong OpenAgentSkill Trust Score across adoption, recent maintenance, license clarity, documentation, dependency/runtime risk, install safety, permission surface, and install availability.","recommendedAction":"Shortlist for production use, then run a normal repository and dependency review.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":100,"weight":0.13,"status":"pass","detail":"25K GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":97,"weight":0.08,"status":"pass","detail":"25K stars, 1.9K forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"22d since push"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"Apache-2.0"},{"id":"documentation","label":"README/SKILL.md completeness","score":74,"weight":0.14,"status":"info","detail":"Public metadata needs stronger README/SKILL.md context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":90,"weight":0.12,"status":"pass","detail":"no major dependency risk hints in public metadata"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add gocolly/colly"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":100,"weight":0.07,"status":"pass","detail":"no high-risk permission surface in public metadata"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/gocolly/colly"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"}],"checks":[{"status":"pass","label":"GitHub adoption","detail":"25K GitHub stars"},{"status":"pass","label":"Stars/forks activity","detail":"25K stars, 1.9K forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"22d since push"},{"status":"pass","label":"License clarity","detail":"Apache-2.0"},{"status":"info","label":"README/SKILL.md completeness","detail":"Public metadata needs stronger README/SKILL.md context"},{"status":"pass","label":"Dependency/runtime risk","detail":"no major dependency risk hints in public metadata"},{"status":"pass","label":"Install availability","detail":"npx skills add gocolly/colly"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"no high-risk permission surface in public metadata"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/gocolly/colly"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"pass","label":"Ownership","detail":"Listing manually verified"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"}],"strengths":["Manually verified listing","AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Large GitHub adoption signal","Install command has no obvious high-risk pattern"],"warnings":["Documentation summary is thin"],"evidence":{"stars":"25K GitHub stars","repoActivity":"25K stars, 1.9K forks","lastPushed":"22d since push","license":"Apache-2.0","repository":"https://github.com/gocolly/colly","install":"npx skills add gocolly/colly","installSafety":"standard package or runtime install path","permissionSurface":"no high-risk permission surface in public metadata","documentation":"Usable metadata, review docs"},"installReadiness":{"ready":true,"command":"npx skills add gocolly/colly","policy":"agent_install_candidate","label":"Agent install candidate","notes":["Install path is available","Repository evidence is available","License is declared","22d since push"]},"agentCompatibility":["Go","Crawler","Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"low","label":"Low metadata risk","notes":["Documentation summary is thin"]}},"safety":{"score":84,"level":"review_before_install","label":"Review before install","safety_tier":{"tier":"reviewed","label":"Reviewed","badge":"REVIEWED","summary":"Good audit and safety signals with no high-risk permission hints in public metadata.","recommended_action":"Review the audit page, then allow agent install in a sandboxed workflow.","auto_install_policy":"review","reasons":["Safe-to-try audit","84/100 agent safety score"]},"auto_install_allowed":false,"human_review_required":true,"blocked":false,"audit_risk":"safe_to_try","permission_hints":[{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"}],"policy_warnings":["Documentation summary is thin"],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"reviewed","label":"Reviewed","badge":"REVIEWED","auto_install_policy":"review","auto_install_allowed":false,"human_review_required":true,"blocked":false,"recommended_action":"Review the audit page, then allow agent install in a sandboxed workflow.","reasons":["Safe-to-try audit","84/100 agent safety score"]},"supply_profile":{"track":{"slug":"coding","label":"Coding and developer agents","shortLabel":"Coding","description":"Code review, repo analysis, testing, CI, GitHub, DevOps, and developer workflow skills."},"scenario":{"label":"Coding agents","description":"I need a coding agent that can understand a repository, edit code, and review pull requests.","useCases":[{"slug":"web-scraping","title":"Web scraping"},{"slug":"coding-agents","title":"Coding agents"},{"slug":"sports-analytics","title":"Sports analytics"}]},"applicableAgents":["Claude Code","CLI","Codex","Cursor","Go"],"install":{"ready":true,"command":"npx skills add gocolly/colly","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":25331,"starsLabel":"25K","forks":1850,"license":"Apache-2.0","qualityScore":100,"trustScore":96,"auditScore":96},"maintenance":{"status":"fresh","label":"22d since push","daysSincePush":22,"lastPushedAt":"2026-05-25T17:37:56+00:00"},"risk":{"level":"safe_to_try","label":"Safe to try","requiresReview":true,"notes":["Documentation summary is thin"]},"coverageTags":["Coding","Coding agents","web-automation","crawler","data-extraction","crawling","framework","go"]},"audit":{"audit_score":96,"risk_level":"safe_to_try","risk_label":"Safe to try","warnings":["Documentation summary is thin"]},"decision":{"readiness_score":100,"readiness_label":"Production-ready","headline":"Primary pick for Web scraping","role":"Primary pick","primary_fit":"Web scraping","best_for":["Web scraping workflows","Claude Code teams","teams that value GitHub adoption signals"],"risks":["No OpenAgentSkill engagement data yet"],"next_steps":["Install it in a sandbox agent and run one Web scraping task end to end.","Compare output quality, latency, and failure behavior against at least one alternative.","Promote it into production only after reviewing repository permissions, license, and maintenance signals."]},"platforms":["Go","Crawler","Claude Code"],"use_cases":[{"slug":"web-scraping","title":"Web scraping","url":"https://www.openagentskill.com/use-cases/web-scraping"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"},{"slug":"sports-analytics","title":"Sports analytics","url":"https://www.openagentskill.com/use-cases/sports-analytics"},{"slug":"github-automation","title":"GitHub automation","url":"https://www.openagentskill.com/use-cases/github-automation"}],"install":"npx skills add gocolly/colly","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx skills add gocolly/colly","description":"Use the registry command when your workflow supports the OpenAgentSkill installer.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"Colly\" agent skill from https://github.com/gocolly/colly. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Elegant Scraper and Crawler Framework for Golang","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"Colly\" as a Claude Code skill from https://github.com/gocolly/colly. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Elegant Scraper and Crawler Framework for Golang","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"Colly\" from https://github.com/gocolly/colly into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Elegant Scraper and Crawler Framework for Golang","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/gocolly/colly","github_repo":"gocolly/colly","version":"1.0.0","license":"Apache-2.0","updated_at":"2026-06-12T02:00:46.282655+00:00","canonical_key":"gocolly/colly","recommendation_reasons":["Matches task terms: crawler","Strong GitHub adoption: 25,331 stars","Quality score 74/100","Install handoff is available","Repository freshness signal is available"],"urls":{"web":"https://www.openagentskill.com/skills/gocolly-colly","api":"https://www.openagentskill.com/api/agent/skills/gocolly-colly","install_api":"https://www.openagentskill.com/api/skills/gocolly-colly/install","audit":"https://www.openagentskill.com/skills/gocolly-colly/audit","repository":"https://github.com/gocolly/colly"}},{"rank":3,"match_score":252.8,"slug":"crawl4ai","name":"Crawl4AI","description":"Open-source LLM-friendly web crawler and scraper","tagline":"Web crawling built for AI","category":"web-automation","tags":["web-crawling","scraping","llm","data-extraction"],"author":{"name":"unclecode","verified":true,"url":null},"attribution":{"status":"registry_indexed","statusLabel":"Registry indexed","shortLabel":"REGISTRY INDEXED","sourceLabel":"API submitted","sourceDetail":"unclecode/crawl4ai","creatorName":"unclecode","creatorUrl":"https://github.com/unclecode/crawl4ai","sourceUrl":"https://github.com/unclecode/crawl4ai","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/crawl4ai#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":66195,"forks":6763,"downloads":31000,"rating":4.9,"review_count":0,"quality_score":79.25},"quality":{"score":100,"tier":"excellent","label":"Excellent","summary":"High-confidence pick with strong adoption and healthy maintenance signals.","signals":[{"label":"GitHub stars","value":"66K","tone":"positive"},{"label":"Freshness","value":"25d ago","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"Apache-2.0","tone":"neutral"}],"warnings":[]},"trust":{"version":"trust-score-v3","score":97,"tier":"production","label":"Production candidate","summary":"Strong OpenAgentSkill Trust Score across adoption, recent maintenance, license clarity, documentation, dependency/runtime risk, install safety, permission surface, and install availability.","recommendedAction":"Shortlist for production use, then run a normal repository and dependency review.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":100,"weight":0.13,"status":"pass","detail":"66K GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":100,"weight":0.08,"status":"pass","detail":"66K stars, 6.8K forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"25d since push"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"Apache-2.0"},{"id":"documentation","label":"README/SKILL.md completeness","score":74,"weight":0.14,"status":"info","detail":"Public metadata needs stronger README/SKILL.md context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":90,"weight":0.12,"status":"pass","detail":"no major dependency risk hints in public metadata"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add unclecode/crawl4ai"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":100,"weight":0.07,"status":"pass","detail":"no high-risk permission surface in public metadata"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/unclecode/crawl4ai"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"}],"checks":[{"status":"pass","label":"GitHub adoption","detail":"66K GitHub stars"},{"status":"pass","label":"Stars/forks activity","detail":"66K stars, 6.8K forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"25d since push"},{"status":"pass","label":"License clarity","detail":"Apache-2.0"},{"status":"info","label":"README/SKILL.md completeness","detail":"Public metadata needs stronger README/SKILL.md context"},{"status":"pass","label":"Dependency/runtime risk","detail":"no major dependency risk hints in public metadata"},{"status":"pass","label":"Install availability","detail":"npx skills add unclecode/crawl4ai"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"no high-risk permission surface in public metadata"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/unclecode/crawl4ai"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"pass","label":"Ownership","detail":"Listing manually verified"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"}],"strengths":["Manually verified listing","AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Large GitHub adoption signal","Install command has no obvious high-risk pattern"],"warnings":["Documentation summary is thin"],"evidence":{"stars":"66K GitHub stars","repoActivity":"66K stars, 6.8K forks","lastPushed":"25d since push","license":"Apache-2.0","repository":"https://github.com/unclecode/crawl4ai","install":"npx skills add unclecode/crawl4ai","installSafety":"standard package or runtime install path","permissionSurface":"no high-risk permission surface in public metadata","documentation":"Usable metadata, review docs"},"installReadiness":{"ready":true,"command":"npx skills add unclecode/crawl4ai","policy":"agent_install_candidate","label":"Agent install candidate","notes":["Install path is available","Repository evidence is available","License is declared","25d since push"]},"agentCompatibility":["Claude","GPT-4","LangChain","CrewAI","OpenClaw","Codex"],"riskSummary":{"level":"low","label":"Low metadata risk","notes":["Documentation summary is thin"]}},"safety":{"score":80,"level":"review_before_install","label":"Review before install","safety_tier":{"tier":"reviewed","label":"Reviewed","badge":"REVIEWED","summary":"Good audit and safety signals with no high-risk permission hints in public metadata.","recommended_action":"Review the audit page, then allow agent install in a sandboxed workflow.","auto_install_policy":"review","reasons":["Safe-to-try audit","80/100 agent safety score"]},"auto_install_allowed":false,"human_review_required":true,"blocked":false,"audit_risk":"safe_to_try","permission_hints":[{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"},{"id":"filesystem","label":"Filesystem access","reason":"Skill may read or write project files, documents, generated artifacts, or local workspace state.","severity":"medium"}],"policy_warnings":["Documentation summary is thin"],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"reviewed","label":"Reviewed","badge":"REVIEWED","auto_install_policy":"review","auto_install_allowed":false,"human_review_required":true,"blocked":false,"recommended_action":"Review the audit page, then allow agent install in a sandboxed workflow.","reasons":["Safe-to-try audit","80/100 agent safety score"]},"supply_profile":{"track":{"slug":"research","label":"Research and knowledge work","shortLabel":"Research","description":"Deep research, source comparison, literature review, RAG, knowledge search, and reports."},"scenario":{"label":"Document processing","description":"I need my agent to read PDFs, extract tables, and turn documents into structured data.","useCases":[{"slug":"web-scraping","title":"Web scraping"},{"slug":"browser-automation","title":"Browser automation"},{"slug":"document-processing","title":"Document processing"}]},"applicableAgents":["Claude Code","OpenAI Agents","LangChain","CLI","Codex"],"install":{"ready":true,"command":"npx skills add unclecode/crawl4ai","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":66195,"starsLabel":"66K","forks":6763,"license":"Apache-2.0","qualityScore":100,"trustScore":97,"auditScore":96},"maintenance":{"status":"fresh","label":"25d since push","daysSincePush":25,"lastPushedAt":"2026-05-22T11:42:05+00:00"},"risk":{"level":"safe_to_try","label":"Safe to try","requiresReview":true,"notes":["Documentation summary is thin"]},"coverageTags":["Research","Document processing","web-automation","web-crawling","scraping","llm","data-extraction","Claude"]},"audit":{"audit_score":96,"risk_level":"safe_to_try","risk_label":"Safe to try","warnings":["Documentation summary is thin"]},"decision":{"readiness_score":100,"readiness_label":"Production-ready","headline":"Primary pick for Web scraping","role":"Primary pick","primary_fit":"Web scraping","best_for":["Web scraping workflows","Claude Code teams","teams that value GitHub adoption signals"],"risks":["No OpenAgentSkill engagement data yet"],"next_steps":["Install it in a sandbox agent and run one Web scraping task end to end.","Compare output quality, latency, and failure behavior against at least one alternative.","Promote it into production only after reviewing repository permissions, license, and maintenance signals."]},"platforms":["Claude","GPT-4","LangChain","CrewAI","OpenClaw","Claude Code","OpenAI Agents"],"use_cases":[{"slug":"web-scraping","title":"Web scraping","url":"https://www.openagentskill.com/use-cases/web-scraping"},{"slug":"browser-automation","title":"Browser automation","url":"https://www.openagentskill.com/use-cases/browser-automation"},{"slug":"document-processing","title":"Document processing","url":"https://www.openagentskill.com/use-cases/document-processing"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"}],"install":"npx skills add unclecode/crawl4ai","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx skills add unclecode/crawl4ai","description":"Use the registry command when your workflow supports the OpenAgentSkill installer.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"Crawl4AI\" agent skill from https://github.com/unclecode/crawl4ai. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Open-source LLM-friendly web crawler and scraper","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"Crawl4AI\" as a Claude Code skill from https://github.com/unclecode/crawl4ai. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Open-source LLM-friendly web crawler and scraper","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"Crawl4AI\" from https://github.com/unclecode/crawl4ai into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Open-source LLM-friendly web crawler and scraper","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/unclecode/crawl4ai","github_repo":"unclecode/crawl4ai","version":"0.4.0","license":"Apache-2.0","updated_at":"2026-05-25T03:01:44.029813+00:00","canonical_key":"unclecode/crawl4ai","recommendation_reasons":["Matches task terms: crawler","Strong GitHub adoption: 66,195 stars","Quality score 79/100","Install handoff is available","Repository freshness signal is available"],"urls":{"web":"https://www.openagentskill.com/skills/crawl4ai","api":"https://www.openagentskill.com/api/agent/skills/crawl4ai","install_api":"https://www.openagentskill.com/api/skills/crawl4ai/install","audit":"https://www.openagentskill.com/skills/crawl4ai/audit","repository":"https://github.com/unclecode/crawl4ai"}},{"rank":4,"match_score":235.3,"slug":"apify-crawlee","name":"Crawlee","description":"Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.","tagline":"Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.","category":"browser-automation","tags":["browser","testing","automation","apify","crawler","crawling","headless","headless-chrome","javascript","nodejs"],"author":{"name":"apify","verified":true,"url":"https://github.com/apify"},"attribution":{"status":"community_indexed","statusLabel":"Community indexed","shortLabel":"COMMUNITY INDEXED","sourceLabel":"GitHub star discovery","sourceDetail":"apify/crawlee","creatorName":"apify","creatorUrl":"https://github.com/apify","sourceUrl":"https://github.com/apify/crawlee","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/apify-crawlee#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":23754,"forks":1429,"downloads":0,"rating":0,"review_count":0,"quality_score":73.83},"quality":{"score":100,"tier":"excellent","label":"Excellent","summary":"High-confidence pick with strong adoption and healthy maintenance signals.","signals":[{"label":"GitHub stars","value":"24K","tone":"positive"},{"label":"Freshness","value":"5d ago","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"Apache-2.0","tone":"neutral"}],"warnings":[]},"trust":{"version":"trust-score-v3","score":96,"tier":"production","label":"Production candidate","summary":"Strong OpenAgentSkill Trust Score across adoption, recent maintenance, license clarity, documentation, dependency/runtime risk, install safety, permission surface, and install availability.","recommendedAction":"Shortlist for production use, then run a normal repository and dependency review.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":100,"weight":0.13,"status":"pass","detail":"24K GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":97,"weight":0.08,"status":"pass","detail":"24K stars, 1.4K forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"5d since push"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"Apache-2.0"},{"id":"documentation","label":"README/SKILL.md completeness","score":90,"weight":0.14,"status":"pass","detail":"Metadata includes enough usage and workflow context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":82,"weight":0.12,"status":"pass","detail":"network or browser surface"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add apify/crawlee"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":72,"weight":0.07,"status":"info","detail":"filesystem or document access, network or browser access"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/apify/crawlee"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"}],"checks":[{"status":"pass","label":"GitHub adoption","detail":"24K GitHub stars"},{"status":"pass","label":"Stars/forks activity","detail":"24K stars, 1.4K forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"5d since push"},{"status":"pass","label":"License clarity","detail":"Apache-2.0"},{"status":"pass","label":"README/SKILL.md completeness","detail":"Metadata includes enough usage and workflow context"},{"status":"pass","label":"Dependency/runtime risk","detail":"network or browser surface"},{"status":"pass","label":"Install availability","detail":"npx skills add apify/crawlee"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"info","label":"Permission surface","detail":"filesystem or document access, network or browser access"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/apify/crawlee"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"pass","label":"Ownership","detail":"Listing manually verified"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"}],"strengths":["Manually verified listing","AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Large GitHub adoption signal","Install command has no obvious high-risk pattern"],"warnings":[],"evidence":{"stars":"24K GitHub stars","repoActivity":"24K stars, 1.4K forks","lastPushed":"5d since push","license":"Apache-2.0","repository":"https://github.com/apify/crawlee","install":"npx skills add apify/crawlee","installSafety":"standard package or runtime install path","permissionSurface":"filesystem or document access, network or browser access","documentation":"Strong README/SKILL.md context"},"installReadiness":{"ready":true,"command":"npx skills add apify/crawlee","policy":"agent_install_candidate","label":"Agent install candidate","notes":["Install path is available","Repository evidence is available","License is declared","5d since push"]},"agentCompatibility":["TypeScript","Playwright","Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"low","label":"Low metadata risk","notes":["No major trust warnings detected from available metadata"]}},"safety":{"score":83,"level":"safe_to_install","label":"Safe to install with normal review","safety_tier":{"tier":"verified","label":"Verified","badge":"VERIFIED","summary":"Strong metadata, audit, install, and review signals. Suitable for agent shortlists after normal workspace review.","recommended_action":"Allow agent install in a sandbox or low-risk workspace, then promote after one successful narrow task.","auto_install_policy":"allow","reasons":["Verified listing","Safe-to-try audit","83/100 agent safety score"]},"auto_install_allowed":true,"human_review_required":false,"blocked":false,"audit_risk":"safe_to_try","permission_hints":[{"id":"browser","label":"Browser automation","reason":"Skill may drive a browser or interact with web pages.","severity":"medium"},{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"},{"id":"filesystem","label":"Filesystem access","reason":"Skill may read or write project files, documents, generated artifacts, or local workspace state.","severity":"medium"}],"policy_warnings":[],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"verified","label":"Verified","badge":"VERIFIED","auto_install_policy":"allow","auto_install_allowed":true,"human_review_required":false,"blocked":false,"recommended_action":"Allow agent install in a sandbox or low-risk workspace, then promote after one successful narrow task.","reasons":["Verified listing","Safe-to-try audit","83/100 agent safety score"]},"supply_profile":{"track":{"slug":"coding","label":"Coding and developer agents","shortLabel":"Coding","description":"Code review, repo analysis, testing, CI, GitHub, DevOps, and developer workflow skills."},"scenario":{"label":"Testing and QA","description":"I need my agent to test a web app, reproduce bugs, and verify fixes.","useCases":[{"slug":"web-scraping","title":"Web scraping"},{"slug":"browser-automation","title":"Browser automation"},{"slug":"testing-qa","title":"Testing and QA"}]},"applicableAgents":["Claude Code","OpenAI Agents","Browser agents","CLI","Codex"],"install":{"ready":true,"command":"npx skills add apify/crawlee","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":23754,"starsLabel":"24K","forks":1429,"license":"Apache-2.0","qualityScore":100,"trustScore":96,"auditScore":95},"maintenance":{"status":"fresh","label":"5d since push","daysSincePush":5,"lastPushedAt":"2026-06-12T10:05:22+00:00"},"risk":{"level":"safe_to_try","label":"Safe to try","requiresReview":false,"notes":["No major risk signals from available metadata"]},"coverageTags":["Coding","Testing and QA","browser-automation","browser","testing","automation","apify","crawler"]},"audit":{"audit_score":95,"risk_level":"safe_to_try","risk_label":"Safe to try","warnings":[]},"decision":{"readiness_score":100,"readiness_label":"Production-ready","headline":"Primary pick for Web scraping","role":"Primary pick","primary_fit":"Web scraping","best_for":["Web scraping workflows","Claude Code teams","teams that value GitHub adoption signals"],"risks":["No OpenAgentSkill engagement data yet"],"next_steps":["Install it in a sandbox agent and run one Web scraping task end to end.","Compare output quality, latency, and failure behavior against at least one alternative.","Promote it into production only after reviewing repository permissions, license, and maintenance signals."]},"platforms":["TypeScript","Playwright","Claude Code","OpenAI Agents","Browser agents"],"use_cases":[{"slug":"web-scraping","title":"Web scraping","url":"https://www.openagentskill.com/use-cases/web-scraping"},{"slug":"browser-automation","title":"Browser automation","url":"https://www.openagentskill.com/use-cases/browser-automation"},{"slug":"testing-qa","title":"Testing and QA","url":"https://www.openagentskill.com/use-cases/testing-qa"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"}],"install":"npx skills add apify/crawlee","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx skills add apify/crawlee","description":"Use the registry command when your workflow supports the OpenAgentSkill installer.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"Crawlee\" agent skill from https://github.com/apify/crawlee. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"Crawlee\" as a Claude Code skill from https://github.com/apify/crawlee. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"Crawlee\" from https://github.com/apify/crawlee into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/apify/crawlee","github_repo":"apify/crawlee","version":"1.0.0","license":"Apache-2.0","updated_at":"2026-06-13T03:00:27.11622+00:00","canonical_key":"apify/crawlee","recommendation_reasons":["Matches task terms: crawler","Strong GitHub adoption: 23,754 stars","Quality score 74/100","Install handoff is available","Repository freshness signal is available"],"urls":{"web":"https://www.openagentskill.com/skills/apify-crawlee","api":"https://www.openagentskill.com/api/agent/skills/apify-crawlee","install_api":"https://www.openagentskill.com/api/skills/apify-crawlee/install","audit":"https://www.openagentskill.com/skills/apify-crawlee/audit","repository":"https://github.com/apify/crawlee"}},{"rank":5,"match_score":222.6,"slug":"firecrawl-firecrawl","name":"Firecrawl","description":"The API to search, scrape, and interact with the web at scale. 🔥","tagline":"The API to search, scrape, and interact with the web at scale. 🔥","category":"agent-frameworks","tags":["agents","ai-agents","ai","ai-crawler","ai-scraping","ai-search","crawler","data-extraction","html-to-markdown","llm"],"author":{"name":"firecrawl","verified":true,"url":"https://github.com/firecrawl"},"attribution":{"status":"community_indexed","statusLabel":"Community indexed","shortLabel":"COMMUNITY INDEXED","sourceLabel":"GitHub star discovery","sourceDetail":"firecrawl/firecrawl","creatorName":"firecrawl","creatorUrl":"https://github.com/firecrawl","sourceUrl":"https://github.com/firecrawl/firecrawl","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/firecrawl-firecrawl#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":132018,"forks":7773,"downloads":0,"rating":0,"review_count":0,"quality_score":78.2},"quality":{"score":100,"tier":"excellent","label":"Excellent","summary":"High-confidence pick with strong adoption and healthy maintenance signals.","signals":[{"label":"GitHub stars","value":"132K","tone":"positive"},{"label":"Freshness","value":"4d ago","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"AGPL-3.0","tone":"neutral"}],"warnings":[]},"trust":{"version":"trust-score-v3","score":95,"tier":"production","label":"Production candidate","summary":"Strong OpenAgentSkill Trust Score across adoption, recent maintenance, license clarity, documentation, dependency/runtime risk, install safety, permission surface, and install availability.","recommendedAction":"Shortlist for production use, then run a normal repository and dependency review.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":100,"weight":0.13,"status":"pass","detail":"132K GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":100,"weight":0.08,"status":"pass","detail":"132K stars, 7.8K forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"4d since push"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"AGPL-3.0"},{"id":"documentation","label":"README/SKILL.md completeness","score":74,"weight":0.14,"status":"info","detail":"Public metadata needs stronger README/SKILL.md context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":82,"weight":0.12,"status":"pass","detail":"network or browser surface"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add firecrawl/firecrawl"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":86,"weight":0.07,"status":"pass","detail":"network or browser access"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/firecrawl/firecrawl"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"}],"checks":[{"status":"pass","label":"GitHub adoption","detail":"132K GitHub stars"},{"status":"pass","label":"Stars/forks activity","detail":"132K stars, 7.8K forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"4d since push"},{"status":"pass","label":"License clarity","detail":"AGPL-3.0"},{"status":"info","label":"README/SKILL.md completeness","detail":"Public metadata needs stronger README/SKILL.md context"},{"status":"pass","label":"Dependency/runtime risk","detail":"network or browser surface"},{"status":"pass","label":"Install availability","detail":"npx skills add firecrawl/firecrawl"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"network or browser access"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/firecrawl/firecrawl"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"pass","label":"Ownership","detail":"Listing manually verified"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"}],"strengths":["Manually verified listing","AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Large GitHub adoption signal","Install command has no obvious high-risk pattern"],"warnings":[],"evidence":{"stars":"132K GitHub stars","repoActivity":"132K stars, 7.8K forks","lastPushed":"4d since push","license":"AGPL-3.0","repository":"https://github.com/firecrawl/firecrawl","install":"npx skills add firecrawl/firecrawl","installSafety":"standard package or runtime install path","permissionSurface":"network or browser access","documentation":"Usable metadata, review docs"},"installReadiness":{"ready":true,"command":"npx skills add firecrawl/firecrawl","policy":"agent_install_candidate","label":"Agent install candidate","notes":["Install path is available","Repository evidence is available","License is declared","4d since push"]},"agentCompatibility":["TypeScript","AI Agents","Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"low","label":"Low metadata risk","notes":["No major trust warnings detected from available metadata"]}},"safety":{"score":87,"level":"safe_to_install","label":"Safe to install with normal review","safety_tier":{"tier":"verified","label":"Verified","badge":"VERIFIED","summary":"Strong metadata, audit, install, and review signals. Suitable for agent shortlists after normal workspace review.","recommended_action":"Allow agent install in a sandbox or low-risk workspace, then promote after one successful narrow task.","auto_install_policy":"allow","reasons":["Verified listing","Safe-to-try audit","87/100 agent safety score"]},"auto_install_allowed":true,"human_review_required":false,"blocked":false,"audit_risk":"safe_to_try","permission_hints":[{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"},{"id":"filesystem","label":"Filesystem access","reason":"Skill may read or write project files, documents, generated artifacts, or local workspace state.","severity":"medium"}],"policy_warnings":[],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"verified","label":"Verified","badge":"VERIFIED","auto_install_policy":"allow","auto_install_allowed":true,"human_review_required":false,"blocked":false,"recommended_action":"Allow agent install in a sandbox or low-risk workspace, then promote after one successful narrow task.","reasons":["Verified listing","Safe-to-try audit","87/100 agent safety score"]},"supply_profile":{"track":{"slug":"coding","label":"Coding and developer agents","shortLabel":"Coding","description":"Code review, repo analysis, testing, CI, GitHub, DevOps, and developer workflow skills."},"scenario":{"label":"Coding agents","description":"I need a coding agent that can understand a repository, edit code, and review pull requests.","useCases":[{"slug":"web-scraping","title":"Web scraping"},{"slug":"coding-agents","title":"Coding agents"},{"slug":"rag-knowledge","title":"RAG and knowledge"}]},"applicableAgents":["Claude Code","CLI","Codex","Cursor","TypeScript"],"install":{"ready":true,"command":"npx skills add firecrawl/firecrawl","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":132018,"starsLabel":"132K","forks":7773,"license":"AGPL-3.0","qualityScore":100,"trustScore":95,"auditScore":95},"maintenance":{"status":"fresh","label":"4d since push","daysSincePush":4,"lastPushedAt":"2026-06-12T23:19:22+00:00"},"risk":{"level":"safe_to_try","label":"Safe to try","requiresReview":false,"notes":["No major risk signals from available metadata"]},"coverageTags":["Coding","Coding agents","agent-frameworks","agents","ai-agents","ai","ai-crawler","ai-scraping"]},"audit":{"audit_score":95,"risk_level":"safe_to_try","risk_label":"Safe to try","warnings":[]},"decision":{"readiness_score":100,"readiness_label":"Production-ready","headline":"Primary pick for Web scraping","role":"Primary pick","primary_fit":"Web scraping","best_for":["Web scraping workflows","Claude Code teams","teams that value GitHub adoption signals"],"risks":["No OpenAgentSkill engagement data yet"],"next_steps":["Install it in a sandbox agent and run one Web scraping task end to end.","Compare output quality, latency, and failure behavior against at least one alternative.","Promote it into production only after reviewing repository permissions, license, and maintenance signals."]},"platforms":["TypeScript","AI Agents","Claude Code"],"use_cases":[{"slug":"web-scraping","title":"Web scraping","url":"https://www.openagentskill.com/use-cases/web-scraping"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"},{"slug":"rag-knowledge","title":"RAG and knowledge","url":"https://www.openagentskill.com/use-cases/rag-knowledge"},{"slug":"document-processing","title":"Document processing","url":"https://www.openagentskill.com/use-cases/document-processing"}],"install":"npx skills add firecrawl/firecrawl","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx skills add firecrawl/firecrawl","description":"Use the registry command when your workflow supports the OpenAgentSkill installer.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"Firecrawl\" agent skill from https://github.com/firecrawl/firecrawl. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: The API to search, scrape, and interact with the web at scale. 🔥","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"Firecrawl\" as a Claude Code skill from https://github.com/firecrawl/firecrawl. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: The API to search, scrape, and interact with the web at scale. 🔥","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"Firecrawl\" from https://github.com/firecrawl/firecrawl into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: The API to search, scrape, and interact with the web at scale. 🔥","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/firecrawl/firecrawl","github_repo":"firecrawl/firecrawl","version":"1.0.0","license":"AGPL-3.0","updated_at":"2026-06-13T03:00:39.404468+00:00","canonical_key":"firecrawl/firecrawl","recommendation_reasons":["Matches task terms: crawler","Strong GitHub adoption: 132,018 stars","Quality score 78/100","Install handoff is available","Repository freshness signal is available"],"urls":{"web":"https://www.openagentskill.com/skills/firecrawl-firecrawl","api":"https://www.openagentskill.com/api/agent/skills/firecrawl-firecrawl","install_api":"https://www.openagentskill.com/api/skills/firecrawl-firecrawl/install","audit":"https://www.openagentskill.com/skills/firecrawl-firecrawl/audit","repository":"https://github.com/firecrawl/firecrawl"}},{"rank":6,"match_score":221.6,"slug":"scrapegraphai-scrapegraph-ai","name":"Scrapegraph AI","description":"Python scraper based on AI","tagline":"Python scraper based on AI","category":"web-automation","tags":["scraping","crawler","ai-crawler","ai-scraping","ai-search","data-extraction","firecrawl-alternative","large-language-model","llm","markdown"],"author":{"name":"ScrapeGraphAI","verified":true,"url":"https://github.com/ScrapeGraphAI"},"attribution":{"status":"community_indexed","statusLabel":"Community indexed","shortLabel":"COMMUNITY INDEXED","sourceLabel":"GitHub star discovery","sourceDetail":"ScrapeGraphAI/Scrapegraph-ai","creatorName":"ScrapeGraphAI","creatorUrl":"https://github.com/ScrapeGraphAI","sourceUrl":"https://github.com/ScrapeGraphAI/Scrapegraph-ai","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/scrapegraphai-scrapegraph-ai#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":27245,"forks":2569,"downloads":0,"rating":0,"review_count":0,"quality_score":74.25},"quality":{"score":100,"tier":"excellent","label":"Excellent","summary":"High-confidence pick with strong adoption and healthy maintenance signals.","signals":[{"label":"GitHub stars","value":"27K","tone":"positive"},{"label":"Freshness","value":"1d ago","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"MIT","tone":"neutral"}],"warnings":[]},"trust":{"version":"trust-score-v3","score":93,"tier":"production","label":"Production candidate","summary":"Strong OpenAgentSkill Trust Score across adoption, recent maintenance, license clarity, documentation, dependency/runtime risk, install safety, permission surface, and install availability.","recommendedAction":"Shortlist for production use, then run a normal repository and dependency review.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":100,"weight":0.13,"status":"pass","detail":"27K GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":97,"weight":0.08,"status":"pass","detail":"27K stars, 2.6K forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"1d since push"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"MIT"},{"id":"documentation","label":"README/SKILL.md completeness","score":50,"weight":0.14,"status":"warn","detail":"Public metadata needs stronger README/SKILL.md context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":90,"weight":0.12,"status":"pass","detail":"no major dependency risk hints in public metadata"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add ScrapeGraphAI/Scrapegraph-ai"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":100,"weight":0.07,"status":"pass","detail":"no high-risk permission surface in public metadata"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/ScrapeGraphAI/Scrapegraph-ai"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"}],"checks":[{"status":"pass","label":"GitHub adoption","detail":"27K GitHub stars"},{"status":"pass","label":"Stars/forks activity","detail":"27K stars, 2.6K forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"1d since push"},{"status":"pass","label":"License clarity","detail":"MIT"},{"status":"warn","label":"README/SKILL.md completeness","detail":"Public metadata needs stronger README/SKILL.md context"},{"status":"pass","label":"Dependency/runtime risk","detail":"no major dependency risk hints in public metadata"},{"status":"pass","label":"Install availability","detail":"npx skills add ScrapeGraphAI/Scrapegraph-ai"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"no high-risk permission surface in public metadata"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/ScrapeGraphAI/Scrapegraph-ai"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"pass","label":"Ownership","detail":"Listing manually verified"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"}],"strengths":["Manually verified listing","AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Large GitHub adoption signal","Install command has no obvious high-risk pattern"],"warnings":["Documentation summary is thin","README/SKILL.md completeness: Public metadata needs stronger README/SKILL.md context"],"evidence":{"stars":"27K GitHub stars","repoActivity":"27K stars, 2.6K forks","lastPushed":"1d since push","license":"MIT","repository":"https://github.com/ScrapeGraphAI/Scrapegraph-ai","install":"npx skills add ScrapeGraphAI/Scrapegraph-ai","installSafety":"standard package or runtime install path","permissionSurface":"no high-risk permission surface in public metadata","documentation":"Thin public metadata"},"installReadiness":{"ready":true,"command":"npx skills add ScrapeGraphAI/Scrapegraph-ai","policy":"agent_install_candidate","label":"Agent install candidate","notes":["Install path is available","Repository evidence is available","License is declared","1d since push"]},"agentCompatibility":["Python","Web Automation","Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"medium","label":"Review before production","notes":["Documentation summary is thin","README/SKILL.md completeness: Public metadata needs stronger README/SKILL.md context"]}},"safety":{"score":75,"level":"review_before_install","label":"Review before install","safety_tier":{"tier":"reviewed","label":"Reviewed","badge":"REVIEWED","summary":"Good audit and safety signals with no high-risk permission hints in public metadata.","recommended_action":"Review the audit page, then allow agent install in a sandboxed workflow.","auto_install_policy":"review","reasons":["Safe-to-try audit","75/100 agent safety score"]},"auto_install_allowed":false,"human_review_required":true,"blocked":false,"audit_risk":"safe_to_try","permission_hints":[{"id":"browser","label":"Browser automation","reason":"Skill may drive a browser or interact with web pages.","severity":"medium"},{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"},{"id":"filesystem","label":"Filesystem access","reason":"Skill may read or write project files, documents, generated artifacts, or local workspace state.","severity":"medium"}],"policy_warnings":["Documentation summary is thin"],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"reviewed","label":"Reviewed","badge":"REVIEWED","auto_install_policy":"review","auto_install_allowed":false,"human_review_required":true,"blocked":false,"recommended_action":"Review the audit page, then allow agent install in a sandboxed workflow.","reasons":["Safe-to-try audit","75/100 agent safety score"]},"supply_profile":{"track":{"slug":"research","label":"Research and knowledge work","shortLabel":"Research","description":"Deep research, source comparison, literature review, RAG, knowledge search, and reports."},"scenario":{"label":"RAG and knowledge","description":"I need my agent to build a RAG workflow over documents and retrieve reliable context.","useCases":[{"slug":"web-scraping","title":"Web scraping"},{"slug":"browser-automation","title":"Browser automation"},{"slug":"coding-agents","title":"Coding agents"}]},"applicableAgents":["Claude Code","CLI","Codex","Cursor","Python"],"install":{"ready":true,"command":"npx skills add ScrapeGraphAI/Scrapegraph-ai","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":27245,"starsLabel":"27K","forks":2569,"license":"MIT","qualityScore":100,"trustScore":93,"auditScore":95},"maintenance":{"status":"fresh","label":"1d since push","daysSincePush":1,"lastPushedAt":"2026-06-15T14:03:01+00:00"},"risk":{"level":"safe_to_try","label":"Safe to try","requiresReview":true,"notes":["Documentation summary is thin","README/SKILL.md completeness: Public metadata needs stronger README/SKILL.md context"]},"coverageTags":["Research","RAG and knowledge","web-automation","scraping","crawler","ai-crawler","ai-scraping","ai-search"]},"audit":{"audit_score":95,"risk_level":"safe_to_try","risk_label":"Safe to try","warnings":["Documentation summary is thin","README/SKILL.md completeness: Public metadata needs stronger README/SKILL.md context"]},"decision":{"readiness_score":100,"readiness_label":"Production-ready","headline":"Primary pick for Web scraping","role":"Primary pick","primary_fit":"Web scraping","best_for":["Web scraping workflows","Claude Code teams","teams that value GitHub adoption signals"],"risks":["No OpenAgentSkill engagement data yet"],"next_steps":["Install it in a sandbox agent and run one Web scraping task end to end.","Compare output quality, latency, and failure behavior against at least one alternative.","Promote it into production only after reviewing repository permissions, license, and maintenance signals."]},"platforms":["Python","Web Automation","Claude Code"],"use_cases":[{"slug":"web-scraping","title":"Web scraping","url":"https://www.openagentskill.com/use-cases/web-scraping"},{"slug":"browser-automation","title":"Browser automation","url":"https://www.openagentskill.com/use-cases/browser-automation"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"},{"slug":"rag-knowledge","title":"RAG and knowledge","url":"https://www.openagentskill.com/use-cases/rag-knowledge"}],"install":"npx skills add ScrapeGraphAI/Scrapegraph-ai","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx skills add ScrapeGraphAI/Scrapegraph-ai","description":"Use the registry command when your workflow supports the OpenAgentSkill installer.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"Scrapegraph AI\" agent skill from https://github.com/ScrapeGraphAI/Scrapegraph-ai. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Python scraper based on AI","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"Scrapegraph AI\" as a Claude Code skill from https://github.com/ScrapeGraphAI/Scrapegraph-ai. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Python scraper based on AI","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"Scrapegraph AI\" from https://github.com/ScrapeGraphAI/Scrapegraph-ai into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Python scraper based on AI","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/ScrapeGraphAI/Scrapegraph-ai","github_repo":"ScrapeGraphAI/Scrapegraph-ai","version":"1.0.0","license":"MIT","updated_at":"2026-06-16T03:00:01.281701+00:00","canonical_key":"scrapegraphai/scrapegraph-ai","recommendation_reasons":["Matches task terms: crawler","Strong GitHub adoption: 27,245 stars","Quality score 74/100","Install handoff is available","Repository freshness signal is available"],"urls":{"web":"https://www.openagentskill.com/skills/scrapegraphai-scrapegraph-ai","api":"https://www.openagentskill.com/api/agent/skills/scrapegraphai-scrapegraph-ai","install_api":"https://www.openagentskill.com/api/skills/scrapegraphai-scrapegraph-ai/install","audit":"https://www.openagentskill.com/skills/scrapegraphai-scrapegraph-ai/audit","repository":"https://github.com/ScrapeGraphAI/Scrapegraph-ai"}},{"rank":7,"match_score":213.3,"slug":"jhao104-proxy-pool","name":"Proxy Pool","description":"Python ProxyPool for web spider","tagline":"Python ProxyPool for web spider","category":"web-automation","tags":["crawler","data-extraction","http","proxy","redis","spider","python","github"],"author":{"name":"jhao104","verified":true,"url":"https://github.com/jhao104"},"attribution":{"status":"community_indexed","statusLabel":"Community indexed","shortLabel":"COMMUNITY INDEXED","sourceLabel":"GitHub star discovery","sourceDetail":"jhao104/proxy_pool","creatorName":"jhao104","creatorUrl":"https://github.com/jhao104","sourceUrl":"https://github.com/jhao104/proxy_pool","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/jhao104-proxy-pool#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":23402,"forks":5390,"downloads":0,"rating":0,"review_count":0,"quality_score":73.78},"quality":{"score":100,"tier":"excellent","label":"Excellent","summary":"High-confidence pick with strong adoption and healthy maintenance signals.","signals":[{"label":"GitHub stars","value":"23K","tone":"positive"},{"label":"Freshness","value":"7d ago","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"MIT","tone":"neutral"}],"warnings":[]},"trust":{"version":"trust-score-v3","score":94,"tier":"production","label":"Production candidate","summary":"Strong OpenAgentSkill Trust Score across adoption, recent maintenance, license clarity, documentation, dependency/runtime risk, install safety, permission surface, and install availability.","recommendedAction":"Shortlist for production use, then run a normal repository and dependency review.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":100,"weight":0.13,"status":"pass","detail":"23K GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":100,"weight":0.08,"status":"pass","detail":"23K stars, 5.4K forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"7d since push"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"MIT"},{"id":"documentation","label":"README/SKILL.md completeness","score":74,"weight":0.14,"status":"info","detail":"Public metadata needs stronger README/SKILL.md context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":82,"weight":0.12,"status":"pass","detail":"network or browser surface"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add jhao104/proxy_pool"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":72,"weight":0.07,"status":"info","detail":"filesystem or document access, network or browser access"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/jhao104/proxy_pool"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"}],"checks":[{"status":"pass","label":"GitHub adoption","detail":"23K GitHub stars"},{"status":"pass","label":"Stars/forks activity","detail":"23K stars, 5.4K forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"7d since push"},{"status":"pass","label":"License clarity","detail":"MIT"},{"status":"info","label":"README/SKILL.md completeness","detail":"Public metadata needs stronger README/SKILL.md context"},{"status":"pass","label":"Dependency/runtime risk","detail":"network or browser surface"},{"status":"pass","label":"Install availability","detail":"npx skills add jhao104/proxy_pool"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"info","label":"Permission surface","detail":"filesystem or document access, network or browser access"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/jhao104/proxy_pool"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"pass","label":"Ownership","detail":"Listing manually verified"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"}],"strengths":["Manually verified listing","AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Large GitHub adoption signal","Install command has no obvious high-risk pattern"],"warnings":["Documentation summary is thin"],"evidence":{"stars":"23K GitHub stars","repoActivity":"23K stars, 5.4K forks","lastPushed":"7d since push","license":"MIT","repository":"https://github.com/jhao104/proxy_pool","install":"npx skills add jhao104/proxy_pool","installSafety":"standard package or runtime install path","permissionSurface":"filesystem or document access, network or browser access","documentation":"Usable metadata, review docs"},"installReadiness":{"ready":true,"command":"npx skills add jhao104/proxy_pool","policy":"agent_install_candidate","label":"Agent install candidate","notes":["Install path is available","Repository evidence is available","License is declared","7d since push"]},"agentCompatibility":["Python","Crawler","Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"low","label":"Low metadata risk","notes":["Documentation summary is thin"]}},"safety":{"score":79,"level":"review_before_install","label":"Review before install","safety_tier":{"tier":"reviewed","label":"Reviewed","badge":"REVIEWED","summary":"Good audit and safety signals with no high-risk permission hints in public metadata.","recommended_action":"Review the audit page, then allow agent install in a sandboxed workflow.","auto_install_policy":"review","reasons":["Safe-to-try audit","79/100 agent safety score"]},"auto_install_allowed":false,"human_review_required":true,"blocked":false,"audit_risk":"safe_to_try","permission_hints":[{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"},{"id":"filesystem","label":"Filesystem access","reason":"Skill may read or write project files, documents, generated artifacts, or local workspace state.","severity":"medium"}],"policy_warnings":["Documentation summary is thin"],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"reviewed","label":"Reviewed","badge":"REVIEWED","auto_install_policy":"review","auto_install_allowed":false,"human_review_required":true,"blocked":false,"recommended_action":"Review the audit page, then allow agent install in a sandboxed workflow.","reasons":["Safe-to-try audit","79/100 agent safety score"]},"supply_profile":{"track":{"slug":"research","label":"Research and knowledge work","shortLabel":"Research","description":"Deep research, source comparison, literature review, RAG, knowledge search, and reports."},"scenario":{"label":"RAG and knowledge","description":"I need my agent to build a RAG workflow over documents and retrieve reliable context.","useCases":[{"slug":"web-scraping","title":"Web scraping"},{"slug":"coding-agents","title":"Coding agents"},{"slug":"rag-knowledge","title":"RAG and knowledge"}]},"applicableAgents":["Claude Code","CLI","Codex","Cursor","Python"],"install":{"ready":true,"command":"npx skills add jhao104/proxy_pool","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":23402,"starsLabel":"23K","forks":5390,"license":"MIT","qualityScore":100,"trustScore":94,"auditScore":95},"maintenance":{"status":"fresh","label":"7d since push","daysSincePush":7,"lastPushedAt":"2026-06-09T13:04:09+00:00"},"risk":{"level":"safe_to_try","label":"Safe to try","requiresReview":true,"notes":["Documentation summary is thin"]},"coverageTags":["Research","RAG and knowledge","web-automation","crawler","data-extraction","http","proxy","redis"]},"audit":{"audit_score":95,"risk_level":"safe_to_try","risk_label":"Safe to try","warnings":["Documentation summary is thin"]},"decision":{"readiness_score":100,"readiness_label":"Production-ready","headline":"Primary pick for Web scraping","role":"Primary pick","primary_fit":"Web scraping","best_for":["Web scraping workflows","Claude Code teams","teams that value GitHub adoption signals"],"risks":["No OpenAgentSkill engagement data yet"],"next_steps":["Install it in a sandbox agent and run one Web scraping task end to end.","Compare output quality, latency, and failure behavior against at least one alternative.","Promote it into production only after reviewing repository permissions, license, and maintenance signals."]},"platforms":["Python","Crawler","Claude Code"],"use_cases":[{"slug":"web-scraping","title":"Web scraping","url":"https://www.openagentskill.com/use-cases/web-scraping"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"},{"slug":"rag-knowledge","title":"RAG and knowledge","url":"https://www.openagentskill.com/use-cases/rag-knowledge"},{"slug":"workflow-automation","title":"Workflow automation","url":"https://www.openagentskill.com/use-cases/workflow-automation"}],"install":"npx skills add jhao104/proxy_pool","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx skills add jhao104/proxy_pool","description":"Use the registry command when your workflow supports the OpenAgentSkill installer.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"Proxy Pool\" agent skill from https://github.com/jhao104/proxy_pool. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Python ProxyPool for web spider","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"Proxy Pool\" as a Claude Code skill from https://github.com/jhao104/proxy_pool. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Python ProxyPool for web spider","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"Proxy Pool\" from https://github.com/jhao104/proxy_pool into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Python ProxyPool for web spider","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/jhao104/proxy_pool","github_repo":"jhao104/proxy_pool","version":"1.0.0","license":"MIT","updated_at":"2026-06-12T10:01:14.768494+00:00","canonical_key":"jhao104/proxy_pool","recommendation_reasons":["Matches task terms: crawler","Strong GitHub adoption: 23,402 stars","Quality score 74/100","Install handoff is available","Repository freshness signal is available"],"urls":{"web":"https://www.openagentskill.com/skills/jhao104-proxy-pool","api":"https://www.openagentskill.com/api/agent/skills/jhao104-proxy-pool","install_api":"https://www.openagentskill.com/api/skills/jhao104-proxy-pool/install","audit":"https://www.openagentskill.com/skills/jhao104-proxy-pool/audit","repository":"https://github.com/jhao104/proxy_pool"}},{"rank":8,"match_score":212.9,"slug":"iawia002-lux","name":"Lux","description":"👾 Fast and simple video download library and CLI tool written in Go","tagline":"👾 Fast and simple video download library and CLI tool written in Go","category":"web-automation","tags":["crawler","data-extraction","bilibili","download","downloader","go","golang","iqiyi","qq","scraper"],"author":{"name":"iawia002","verified":true,"url":"https://github.com/iawia002"},"attribution":{"status":"community_indexed","statusLabel":"Community indexed","shortLabel":"COMMUNITY INDEXED","sourceLabel":"GitHub star discovery","sourceDetail":"iawia002/lux","creatorName":"iawia002","creatorUrl":"https://github.com/iawia002","sourceUrl":"https://github.com/iawia002/lux","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/iawia002-lux#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":31409,"forks":3306,"downloads":0,"rating":0,"review_count":0,"quality_score":71.68},"quality":{"score":100,"tier":"excellent","label":"Excellent","summary":"High-confidence pick with strong adoption and healthy maintenance signals.","signals":[{"label":"GitHub stars","value":"31K","tone":"positive"},{"label":"Freshness","value":"3mo ago","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"MIT","tone":"neutral"}],"warnings":[]},"trust":{"version":"trust-score-v3","score":91,"tier":"production","label":"Production candidate","summary":"Strong OpenAgentSkill Trust Score across adoption, recent maintenance, license clarity, documentation, dependency/runtime risk, install safety, permission surface, and install availability.","recommendedAction":"Shortlist for production use, then run a normal repository and dependency review.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":100,"weight":0.13,"status":"pass","detail":"31K GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":97,"weight":0.08,"status":"pass","detail":"31K stars, 3.3K forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":88,"weight":0.14,"status":"pass","detail":"3mo since push"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"MIT"},{"id":"documentation","label":"README/SKILL.md completeness","score":74,"weight":0.14,"status":"info","detail":"Public metadata needs stronger README/SKILL.md context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":72,"weight":0.12,"status":"info","detail":"command execution surface"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add iawia002/lux"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":76,"weight":0.07,"status":"info","detail":"shell or command execution"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/iawia002/lux"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"}],"checks":[{"status":"pass","label":"GitHub adoption","detail":"31K GitHub stars"},{"status":"pass","label":"Stars/forks activity","detail":"31K stars, 3.3K forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"3mo since push"},{"status":"pass","label":"License clarity","detail":"MIT"},{"status":"info","label":"README/SKILL.md completeness","detail":"Public metadata needs stronger README/SKILL.md context"},{"status":"info","label":"Dependency/runtime risk","detail":"command execution surface"},{"status":"pass","label":"Install availability","detail":"npx skills add iawia002/lux"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"info","label":"Permission surface","detail":"shell or command execution"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/iawia002/lux"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"pass","label":"Ownership","detail":"Listing manually verified"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"}],"strengths":["Manually verified listing","AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Large GitHub adoption signal","Install command has no obvious high-risk pattern"],"warnings":[],"evidence":{"stars":"31K GitHub stars","repoActivity":"31K stars, 3.3K forks","lastPushed":"3mo since push","license":"MIT","repository":"https://github.com/iawia002/lux","install":"npx skills add iawia002/lux","installSafety":"standard package or runtime install path","permissionSurface":"shell or command execution","documentation":"Usable metadata, review docs"},"installReadiness":{"ready":true,"command":"npx skills add iawia002/lux","policy":"agent_install_candidate","label":"Agent install candidate","notes":["Install path is available","Repository evidence is available","License is declared","3mo since push"]},"agentCompatibility":["Go","Crawler","Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"low","label":"Low metadata risk","notes":["No major trust warnings detected from available metadata"]}},"safety":{"score":68,"level":"review_before_install","label":"Review before install","safety_tier":{"tier":"reviewed","label":"Reviewed with permission notes","badge":"REVIEWED","summary":"Usable candidate, but the agent should surface permission and audit notes before installation.","recommended_action":"Require human approval before installing into a real workspace.","auto_install_policy":"review","reasons":["High-risk permission hints: Shell or command execution","68/100 agent safety score"]},"auto_install_allowed":false,"human_review_required":true,"blocked":false,"audit_risk":"safe_to_try","permission_hints":[{"id":"shell","label":"Shell or command execution","reason":"Skill metadata references terminal, CLI, shell, subprocess, or command execution workflows.","severity":"high"},{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"}],"policy_warnings":["High-risk permission hints: Shell or command execution"],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"reviewed","label":"Reviewed with permission notes","badge":"REVIEWED","auto_install_policy":"review","auto_install_allowed":false,"human_review_required":true,"blocked":false,"recommended_action":"Require human approval before installing into a real workspace.","reasons":["High-risk permission hints: Shell or command execution","68/100 agent safety score"]},"supply_profile":{"track":{"slug":"coding","label":"Coding and developer agents","shortLabel":"Coding","description":"Code review, repo analysis, testing, CI, GitHub, DevOps, and developer workflow skills."},"scenario":{"label":"Coding agents","description":"I need a coding agent that can understand a repository, edit code, and review pull requests.","useCases":[{"slug":"web-scraping","title":"Web scraping"},{"slug":"coding-agents","title":"Coding agents"},{"slug":"sports-analytics","title":"Sports analytics"}]},"applicableAgents":["Claude Code","CLI","Codex","Cursor","Go"],"install":{"ready":true,"command":"npx skills add iawia002/lux","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":31409,"starsLabel":"31K","forks":3306,"license":"MIT","qualityScore":100,"trustScore":91,"auditScore":92},"maintenance":{"status":"active","label":"3mo since push","daysSincePush":79,"lastPushedAt":"2026-03-29T18:18:56+00:00"},"risk":{"level":"safe_to_try","label":"Safe to try","requiresReview":false,"notes":["No major risk signals from available metadata"]},"coverageTags":["Coding","Coding agents","web-automation","crawler","data-extraction","bilibili","download","downloader"]},"audit":{"audit_score":92,"risk_level":"safe_to_try","risk_label":"Safe to try","warnings":[]},"decision":{"readiness_score":100,"readiness_label":"Production-ready","headline":"Primary pick for Web scraping","role":"Primary pick","primary_fit":"Web scraping","best_for":["Web scraping workflows","Claude Code teams","teams that value GitHub adoption signals"],"risks":["No OpenAgentSkill engagement data yet"],"next_steps":["Install it in a sandbox agent and run one Web scraping task end to end.","Compare output quality, latency, and failure behavior against at least one alternative.","Promote it into production only after reviewing repository permissions, license, and maintenance signals."]},"platforms":["Go","Crawler","Claude Code"],"use_cases":[{"slug":"web-scraping","title":"Web scraping","url":"https://www.openagentskill.com/use-cases/web-scraping"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"},{"slug":"sports-analytics","title":"Sports analytics","url":"https://www.openagentskill.com/use-cases/sports-analytics"},{"slug":"github-automation","title":"GitHub automation","url":"https://www.openagentskill.com/use-cases/github-automation"}],"install":"npx skills add iawia002/lux","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx skills add iawia002/lux","description":"Use the registry command when your workflow supports the OpenAgentSkill installer.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"Lux\" agent skill from https://github.com/iawia002/lux. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: 👾 Fast and simple video download library and CLI tool written in Go","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"Lux\" as a Claude Code skill from https://github.com/iawia002/lux. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: 👾 Fast and simple video download library and CLI tool written in Go","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"Lux\" from https://github.com/iawia002/lux into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: 👾 Fast and simple video download library and CLI tool written in Go","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/iawia002/lux","github_repo":"iawia002/lux","version":"1.0.0","license":"MIT","updated_at":"2026-06-14T03:04:24.709044+00:00","canonical_key":"iawia002/lux","recommendation_reasons":["Matches task terms: crawler","Strong GitHub adoption: 31,409 stars","Quality score 72/100","Install handoff is available","Repository freshness signal is available"],"urls":{"web":"https://www.openagentskill.com/skills/iawia002-lux","api":"https://www.openagentskill.com/api/agent/skills/iawia002-lux","install_api":"https://www.openagentskill.com/api/skills/iawia002-lux/install","audit":"https://www.openagentskill.com/skills/iawia002-lux/audit","repository":"https://github.com/iawia002/lux"}},{"rank":9,"match_score":212.4,"slug":"projectdiscovery-katana","name":"Katana","description":"A next-generation crawling and spidering framework.","tagline":"A next-generation crawling and spidering framework.","category":"web-automation","tags":["crawler","data-extraction","cli","gocrawler","hacktoberfest","headless","spider-framework","web-spider","go","github"],"author":{"name":"projectdiscovery","verified":true,"url":"https://github.com/projectdiscovery"},"attribution":{"status":"community_indexed","statusLabel":"Community indexed","shortLabel":"COMMUNITY INDEXED","sourceLabel":"GitHub star discovery","sourceDetail":"projectdiscovery/katana","creatorName":"projectdiscovery","creatorUrl":"https://github.com/projectdiscovery","sourceUrl":"https://github.com/projectdiscovery/katana","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/projectdiscovery-katana#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":17025,"forks":1142,"downloads":0,"rating":0,"review_count":0,"quality_score":72.82},"quality":{"score":100,"tier":"excellent","label":"Excellent","summary":"High-confidence pick with strong adoption and healthy maintenance signals.","signals":[{"label":"GitHub stars","value":"17K","tone":"positive"},{"label":"Freshness","value":"1d ago","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"MIT","tone":"neutral"}],"warnings":[]},"trust":{"version":"trust-score-v3","score":93,"tier":"production","label":"Production candidate","summary":"Strong OpenAgentSkill Trust Score across adoption, recent maintenance, license clarity, documentation, dependency/runtime risk, install safety, permission surface, and install availability.","recommendedAction":"Shortlist for production use, then run a normal repository and dependency review.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":100,"weight":0.13,"status":"pass","detail":"17K GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":97,"weight":0.08,"status":"pass","detail":"17K stars, 1.1K forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"1d since push"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"MIT"},{"id":"documentation","label":"README/SKILL.md completeness","score":74,"weight":0.14,"status":"info","detail":"Public metadata needs stronger README/SKILL.md context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":72,"weight":0.12,"status":"info","detail":"command execution surface"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add projectdiscovery/katana"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":76,"weight":0.07,"status":"info","detail":"shell or command execution"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/projectdiscovery/katana"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"}],"checks":[{"status":"pass","label":"GitHub adoption","detail":"17K GitHub stars"},{"status":"pass","label":"Stars/forks activity","detail":"17K stars, 1.1K forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"1d since push"},{"status":"pass","label":"License clarity","detail":"MIT"},{"status":"info","label":"README/SKILL.md completeness","detail":"Public metadata needs stronger README/SKILL.md context"},{"status":"info","label":"Dependency/runtime risk","detail":"command execution surface"},{"status":"pass","label":"Install availability","detail":"npx skills add projectdiscovery/katana"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"info","label":"Permission surface","detail":"shell or command execution"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/projectdiscovery/katana"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"pass","label":"Ownership","detail":"Listing manually verified"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"}],"strengths":["Manually verified listing","AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Large GitHub adoption signal","Install command has no obvious high-risk pattern"],"warnings":["Documentation summary is thin"],"evidence":{"stars":"17K GitHub stars","repoActivity":"17K stars, 1.1K forks","lastPushed":"1d since push","license":"MIT","repository":"https://github.com/projectdiscovery/katana","install":"npx skills add projectdiscovery/katana","installSafety":"standard package or runtime install path","permissionSurface":"shell or command execution","documentation":"Usable metadata, review docs"},"installReadiness":{"ready":true,"command":"npx skills add projectdiscovery/katana","policy":"agent_install_candidate","label":"Agent install candidate","notes":["Install path is available","Repository evidence is available","License is declared","1d since push"]},"agentCompatibility":["Go","Crawler","Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"low","label":"Low metadata risk","notes":["Documentation summary is thin"]}},"safety":{"score":70,"level":"review_before_install","label":"Review before install","safety_tier":{"tier":"reviewed","label":"Reviewed with permission notes","badge":"REVIEWED","summary":"Usable candidate, but the agent should surface permission and audit notes before installation.","recommended_action":"Require human approval before installing into a real workspace.","auto_install_policy":"review","reasons":["High-risk permission hints: Shell or command execution","70/100 agent safety score"]},"auto_install_allowed":false,"human_review_required":true,"blocked":false,"audit_risk":"safe_to_try","permission_hints":[{"id":"shell","label":"Shell or command execution","reason":"Skill metadata references terminal, CLI, shell, subprocess, or command execution workflows.","severity":"high"},{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"}],"policy_warnings":["High-risk permission hints: Shell or command execution","Documentation summary is thin"],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"reviewed","label":"Reviewed with permission notes","badge":"REVIEWED","auto_install_policy":"review","auto_install_allowed":false,"human_review_required":true,"blocked":false,"recommended_action":"Require human approval before installing into a real workspace.","reasons":["High-risk permission hints: Shell or command execution","70/100 agent safety score"]},"supply_profile":{"track":{"slug":"coding","label":"Coding and developer agents","shortLabel":"Coding","description":"Code review, repo analysis, testing, CI, GitHub, DevOps, and developer workflow skills."},"scenario":{"label":"Coding agents","description":"I need a coding agent that can understand a repository, edit code, and review pull requests.","useCases":[{"slug":"web-scraping","title":"Web scraping"},{"slug":"coding-agents","title":"Coding agents"},{"slug":"document-processing","title":"Document processing"}]},"applicableAgents":["Claude Code","CLI","Codex","Cursor","Go"],"install":{"ready":true,"command":"npx skills add projectdiscovery/katana","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":17025,"starsLabel":"17K","forks":1142,"license":"MIT","qualityScore":100,"trustScore":93,"auditScore":94},"maintenance":{"status":"fresh","label":"1d since push","daysSincePush":1,"lastPushedAt":"2026-06-15T12:22:33+00:00"},"risk":{"level":"safe_to_try","label":"Safe to try","requiresReview":true,"notes":["Documentation summary is thin"]},"coverageTags":["Coding","Coding agents","web-automation","crawler","data-extraction","cli","gocrawler","hacktoberfest"]},"audit":{"audit_score":94,"risk_level":"safe_to_try","risk_label":"Safe to try","warnings":["Documentation summary is thin"]},"decision":{"readiness_score":100,"readiness_label":"Production-ready","headline":"Primary pick for Web scraping","role":"Primary pick","primary_fit":"Web scraping","best_for":["Web scraping workflows","Claude Code teams","teams that value GitHub adoption signals"],"risks":["No OpenAgentSkill engagement data yet"],"next_steps":["Install it in a sandbox agent and run one Web scraping task end to end.","Compare output quality, latency, and failure behavior against at least one alternative.","Promote it into production only after reviewing repository permissions, license, and maintenance signals."]},"platforms":["Go","Crawler","Claude Code"],"use_cases":[{"slug":"web-scraping","title":"Web scraping","url":"https://www.openagentskill.com/use-cases/web-scraping"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"},{"slug":"document-processing","title":"Document processing","url":"https://www.openagentskill.com/use-cases/document-processing"},{"slug":"sports-analytics","title":"Sports analytics","url":"https://www.openagentskill.com/use-cases/sports-analytics"}],"install":"npx skills add projectdiscovery/katana","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx skills add projectdiscovery/katana","description":"Use the registry command when your workflow supports the OpenAgentSkill installer.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"Katana\" agent skill from https://github.com/projectdiscovery/katana. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: A next-generation crawling and spidering framework.","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"Katana\" as a Claude Code skill from https://github.com/projectdiscovery/katana. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: A next-generation crawling and spidering framework.","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"Katana\" from https://github.com/projectdiscovery/katana into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: A next-generation crawling and spidering framework.","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/projectdiscovery/katana","github_repo":"projectdiscovery/katana","version":"1.0.0","license":"MIT","updated_at":"2026-06-16T03:00:59.444805+00:00","canonical_key":"projectdiscovery/katana","recommendation_reasons":["Matches task terms: crawler","Strong GitHub adoption: 17,025 stars","Quality score 73/100","Install handoff is available","Repository freshness signal is available"],"urls":{"web":"https://www.openagentskill.com/skills/projectdiscovery-katana","api":"https://www.openagentskill.com/api/agent/skills/projectdiscovery-katana","install_api":"https://www.openagentskill.com/api/skills/projectdiscovery-katana/install","audit":"https://www.openagentskill.com/skills/projectdiscovery-katana/audit","repository":"https://github.com/projectdiscovery/katana"}},{"rank":10,"match_score":194.2,"slug":"scrapy-scrapy","name":"Scrapy","description":"Scrapy, a fast high-level web crawling & scraping framework for Python.","tagline":"Scrapy, a fast high-level web crawling & scraping framework for Python.","category":"web-automation","tags":["scraping","crawler","crawling","framework","hacktoberfest","python","web-scraping","web-scraping-python","github"],"author":{"name":"scrapy","verified":true,"url":"https://github.com/scrapy"},"attribution":{"status":"community_indexed","statusLabel":"Community indexed","shortLabel":"COMMUNITY INDEXED","sourceLabel":"GitHub star discovery","sourceDetail":"scrapy/scrapy","creatorName":"scrapy","creatorUrl":"https://github.com/scrapy","sourceUrl":"https://github.com/scrapy/scrapy","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/scrapy-scrapy#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":62204,"forks":11640,"downloads":0,"rating":0,"review_count":0,"quality_score":76.76},"quality":{"score":100,"tier":"excellent","label":"Excellent","summary":"High-confidence pick with strong adoption and healthy maintenance signals.","signals":[{"label":"GitHub stars","value":"62K","tone":"positive"},{"label":"Freshness","value":"5d ago","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"BSD-3-Clause","tone":"neutral"}],"warnings":[]},"trust":{"version":"trust-score-v3","score":96,"tier":"production","label":"Production candidate","summary":"Strong OpenAgentSkill Trust Score across adoption, recent maintenance, license clarity, documentation, dependency/runtime risk, install safety, permission surface, and install availability.","recommendedAction":"Shortlist for production use, then run a normal repository and dependency review.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":100,"weight":0.13,"status":"pass","detail":"62K GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":100,"weight":0.08,"status":"pass","detail":"62K stars, 12K forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"5d since push"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"BSD-3-Clause"},{"id":"documentation","label":"README/SKILL.md completeness","score":74,"weight":0.14,"status":"info","detail":"Public metadata needs stronger README/SKILL.md context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":90,"weight":0.12,"status":"pass","detail":"no major dependency risk hints in public metadata"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add scrapy/scrapy"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":86,"weight":0.07,"status":"pass","detail":"filesystem or document access"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/scrapy/scrapy"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"}],"checks":[{"status":"pass","label":"GitHub adoption","detail":"62K GitHub stars"},{"status":"pass","label":"Stars/forks activity","detail":"62K stars, 12K forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"5d since push"},{"status":"pass","label":"License clarity","detail":"BSD-3-Clause"},{"status":"info","label":"README/SKILL.md completeness","detail":"Public metadata needs stronger README/SKILL.md context"},{"status":"pass","label":"Dependency/runtime risk","detail":"no major dependency risk hints in public metadata"},{"status":"pass","label":"Install availability","detail":"npx skills add scrapy/scrapy"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"filesystem or document access"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/scrapy/scrapy"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"pass","label":"Ownership","detail":"Listing manually verified"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"}],"strengths":["Manually verified listing","AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Large GitHub adoption signal","Install command has no obvious high-risk pattern"],"warnings":[],"evidence":{"stars":"62K GitHub stars","repoActivity":"62K stars, 12K forks","lastPushed":"5d since push","license":"BSD-3-Clause","repository":"https://github.com/scrapy/scrapy","install":"npx skills add scrapy/scrapy","installSafety":"standard package or runtime install path","permissionSurface":"filesystem or document access","documentation":"Usable metadata, review docs"},"installReadiness":{"ready":true,"command":"npx skills add scrapy/scrapy","policy":"agent_install_candidate","label":"Agent install candidate","notes":["Install path is available","Repository evidence is available","License is declared","5d since push"]},"agentCompatibility":["Python","Web Automation","Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"low","label":"Low metadata risk","notes":["No major trust warnings detected from available metadata"]}},"safety":{"score":84,"level":"safe_to_install","label":"Safe to install with normal review","safety_tier":{"tier":"verified","label":"Verified","badge":"VERIFIED","summary":"Strong metadata, audit, install, and review signals. Suitable for agent shortlists after normal workspace review.","recommended_action":"Allow agent install in a sandbox or low-risk workspace, then promote after one successful narrow task.","auto_install_policy":"allow","reasons":["Verified listing","Safe-to-try audit","84/100 agent safety score"]},"auto_install_allowed":true,"human_review_required":false,"blocked":false,"audit_risk":"safe_to_try","permission_hints":[{"id":"browser","label":"Browser automation","reason":"Skill may drive a browser or interact with web pages.","severity":"medium"},{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"},{"id":"filesystem","label":"Filesystem access","reason":"Skill may read or write project files, documents, generated artifacts, or local workspace state.","severity":"medium"}],"policy_warnings":[],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"verified","label":"Verified","badge":"VERIFIED","auto_install_policy":"allow","auto_install_allowed":true,"human_review_required":false,"blocked":false,"recommended_action":"Allow agent install in a sandbox or low-risk workspace, then promote after one successful narrow task.","reasons":["Verified listing","Safe-to-try audit","84/100 agent safety score"]},"supply_profile":{"track":{"slug":"coding","label":"Coding and developer agents","shortLabel":"Coding","description":"Code review, repo analysis, testing, CI, GitHub, DevOps, and developer workflow skills."},"scenario":{"label":"Coding agents","description":"I need a coding agent that can understand a repository, edit code, and review pull requests.","useCases":[{"slug":"browser-automation","title":"Browser automation"},{"slug":"web-scraping","title":"Web scraping"},{"slug":"coding-agents","title":"Coding agents"}]},"applicableAgents":["Claude Code","CLI","Codex","Cursor","Python"],"install":{"ready":true,"command":"npx skills add scrapy/scrapy","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":62204,"starsLabel":"62K","forks":11640,"license":"BSD-3-Clause","qualityScore":100,"trustScore":96,"auditScore":96},"maintenance":{"status":"fresh","label":"5d since push","daysSincePush":5,"lastPushedAt":"2026-06-11T10:56:53+00:00"},"risk":{"level":"safe_to_try","label":"Safe to try","requiresReview":false,"notes":["No major risk signals from available metadata"]},"coverageTags":["Coding","Coding agents","web-automation","scraping","crawler","crawling","framework","hacktoberfest"]},"audit":{"audit_score":96,"risk_level":"safe_to_try","risk_label":"Safe to try","warnings":[]},"decision":{"readiness_score":100,"readiness_label":"Production-ready","headline":"Primary pick for Browser automation","role":"Primary pick","primary_fit":"Browser automation","best_for":["Browser automation workflows","Claude Code teams","teams that value GitHub adoption signals"],"risks":["No OpenAgentSkill engagement data yet"],"next_steps":["Install it in a sandbox agent and run one Browser automation task end to end.","Compare output quality, latency, and failure behavior against at least one alternative.","Promote it into production only after reviewing repository permissions, license, and maintenance signals."]},"platforms":["Python","Web Automation","Claude Code"],"use_cases":[{"slug":"browser-automation","title":"Browser automation","url":"https://www.openagentskill.com/use-cases/browser-automation"},{"slug":"web-scraping","title":"Web scraping","url":"https://www.openagentskill.com/use-cases/web-scraping"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"},{"slug":"rag-knowledge","title":"RAG and knowledge","url":"https://www.openagentskill.com/use-cases/rag-knowledge"}],"install":"npx skills add scrapy/scrapy","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx skills add scrapy/scrapy","description":"Use the registry command when your workflow supports the OpenAgentSkill installer.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"Scrapy\" agent skill from https://github.com/scrapy/scrapy. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Scrapy, a fast high-level web crawling & scraping framework for Python.","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"Scrapy\" as a Claude Code skill from https://github.com/scrapy/scrapy. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Scrapy, a fast high-level web crawling & scraping framework for Python.","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"Scrapy\" from https://github.com/scrapy/scrapy into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Scrapy, a fast high-level web crawling & scraping framework for Python.","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/scrapy/scrapy","github_repo":"scrapy/scrapy","version":"1.0.0","license":"BSD-3-Clause","updated_at":"2026-06-12T10:01:10.654747+00:00","canonical_key":"scrapy/scrapy","recommendation_reasons":["Matches task terms: crawler","Strong GitHub adoption: 62,204 stars","Quality score 77/100","Install handoff is available","Repository freshness signal is available"],"urls":{"web":"https://www.openagentskill.com/skills/scrapy-scrapy","api":"https://www.openagentskill.com/api/agent/skills/scrapy-scrapy","install_api":"https://www.openagentskill.com/api/skills/scrapy-scrapy/install","audit":"https://www.openagentskill.com/skills/scrapy-scrapy/audit","repository":"https://github.com/scrapy/scrapy"}}],"meta":{"endpoint":"/api/skills/search","canonical_agent_endpoint":"/api/agent/resolve","safety_policy":"Blocked candidates are excluded by default. Pass include_blocked=true only for manual audit workflows.","agent_friendly":true,"api_version":"1.0","generated_at":"2026-06-17T10:10:12.846Z"}}