{"slug":"clemlesne-scrape-it-now","name":"Scrape It Now","description":"Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.","tagline":"Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.","category":"document-processing","tags":["markdown","documents","ai","azure","cli","scraper","python","github"],"author":{"name":"clemlesne","verified":false,"url":"https://github.com/clemlesne"},"attribution":{"status":"community_indexed","statusLabel":"Community indexed","shortLabel":"COMMUNITY INDEXED","sourceLabel":"GitHub star discovery","sourceDetail":"clemlesne/scrape-it-now","creatorName":"clemlesne","creatorUrl":"https://github.com/clemlesne","sourceUrl":"https://github.com/clemlesne/scrape-it-now","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/clemlesne-scrape-it-now#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":542,"forks":22,"downloads":0,"rating":0,"review_count":0,"quality_score":41.84},"quality":{"score":67,"tier":"promising","label":"Promising","summary":"Useful candidate, but compare it with alternatives before adopting.","signals":[{"label":"GitHub stars","value":"542","tone":"positive"},{"label":"Freshness","value":"8mo ago","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"Apache-2.0","tone":"neutral"}],"warnings":[]},"trust":{"version":"trust-score-v3","score":77,"tier":"strong","label":"Strong shortlist","summary":"Good trust signals with a few areas worth checking before rollout.","recommendedAction":"Test in a sandbox workflow and compare its install path with close alternatives.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":76,"weight":0.13,"status":"info","detail":"542 GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":65,"weight":0.08,"status":"info","detail":"542 stars, 22 forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":62,"weight":0.14,"status":"info","detail":"8mo since push"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"Apache-2.0"},{"id":"documentation","label":"README/SKILL.md completeness","score":90,"weight":0.14,"status":"pass","detail":"Metadata includes enough usage and workflow context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":64,"weight":0.12,"status":"info","detail":"command execution surface, network or browser surface"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add clemlesne/scrape-it-now"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":48,"weight":0.07,"status":"warn","detail":"shell or command execution, filesystem or document access"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/clemlesne/scrape-it-now"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"}],"checks":[{"status":"info","label":"GitHub adoption","detail":"542 GitHub stars"},{"status":"info","label":"Stars/forks activity","detail":"542 stars, 22 forks; issue activity unavailable in current metadata"},{"status":"info","label":"Recent maintenance","detail":"8mo since push"},{"status":"pass","label":"License clarity","detail":"Apache-2.0"},{"status":"pass","label":"README/SKILL.md completeness","detail":"Metadata includes enough usage and workflow context"},{"status":"info","label":"Dependency/runtime risk","detail":"command execution surface, network or browser surface"},{"status":"pass","label":"Install availability","detail":"npx skills add clemlesne/scrape-it-now"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"warn","label":"Permission surface","detail":"shell or command execution, filesystem or document access"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/clemlesne/scrape-it-now"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"warn","label":"Ownership","detail":"No approved owner claim yet"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"}],"strengths":["AI review approved","Install path is available","Repository evidence is available","Meaningful GitHub adoption signal","Install command has no obvious high-risk pattern"],"warnings":["Quality score needs review","Permission surface needs review: shell or command execution, filesystem or document access","Permission surface: shell or command execution, filesystem or document access"],"evidence":{"stars":"542 GitHub stars","repoActivity":"542 stars, 22 forks","lastPushed":"8mo since push","license":"Apache-2.0","repository":"https://github.com/clemlesne/scrape-it-now","install":"npx skills add clemlesne/scrape-it-now","installSafety":"standard package or runtime install path","permissionSurface":"shell or command execution, filesystem or document access","documentation":"Strong README/SKILL.md context"},"installReadiness":{"ready":true,"command":"npx skills add clemlesne/scrape-it-now","policy":"human_review_before_install","label":"Human review before install","notes":["Install path is available","Repository evidence is available","License is declared","8mo since push"]},"agentCompatibility":["Python","Markdown","Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"medium","label":"Review before production","notes":["Quality score needs review","Permission surface needs review: shell or command execution, filesystem or document access","Permission surface: shell or command execution, filesystem or document access"]}},"safety":{"score":47,"level":"avoid_auto_install","label":"Avoid automatic install","safety_tier":{"tier":"experimental","label":"Experimental","badge":"EXPERIMENTAL","summary":"Sparse or mixed signals. Useful for discovery, but not for autonomous installation.","recommended_action":"Test manually in an isolated workspace and compare against safer alternatives.","auto_install_policy":"review","reasons":["High-risk permission hints: Shell or command execution","47/100 agent safety score"]},"auto_install_allowed":false,"human_review_required":true,"blocked":false,"audit_risk":"needs_review","permission_hints":[{"id":"shell","label":"Shell or command execution","reason":"Skill metadata references terminal, CLI, shell, subprocess, or command execution workflows.","severity":"high"},{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"},{"id":"filesystem","label":"Filesystem access","reason":"Skill may read or write project files, documents, generated artifacts, or local workspace state.","severity":"medium"}],"policy_warnings":["High-risk permission hints: Shell or command execution","Permission surface may require sandboxing"],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"experimental","label":"Experimental","badge":"EXPERIMENTAL","auto_install_policy":"review","auto_install_allowed":false,"human_review_required":true,"blocked":false,"recommended_action":"Test manually in an isolated workspace and compare against safer alternatives.","reasons":["High-risk permission hints: Shell or command execution","47/100 agent safety score"]},"supply_profile":{"track":{"slug":"research","label":"Research and knowledge work","shortLabel":"Research","description":"Deep research, source comparison, literature review, RAG, knowledge search, and reports."},"scenario":{"label":"Document processing","description":"I need my agent to read PDFs, extract tables, and turn documents into structured data.","useCases":[{"slug":"document-processing","title":"Document processing"},{"slug":"github-automation","title":"GitHub automation"},{"slug":"web-scraping","title":"Web scraping"}]},"applicableAgents":["Claude Code","CLI","Codex","Cursor","Python"],"install":{"ready":true,"command":"npx skills add clemlesne/scrape-it-now","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":542,"starsLabel":"542","forks":22,"license":"Apache-2.0","qualityScore":67,"trustScore":77,"auditScore":75},"maintenance":{"status":"stable","label":"8mo since push","daysSincePush":225,"lastPushedAt":"2025-11-03T20:32:03+00:00"},"risk":{"level":"needs_review","label":"Needs review","requiresReview":true,"notes":["Permission surface may require sandboxing","Quality score needs review","Permission surface needs review: shell or command execution, filesystem or document access","Permission surface: shell or command execution, filesystem or document access","Needs review"]},"coverageTags":["Research","Document processing","document-processing","markdown","documents","ai","azure","cli"]},"audit":{"audit_score":75,"risk_level":"needs_review","risk_label":"Needs review","warnings":["Permission surface may require sandboxing","Quality score needs review","Permission surface needs review: shell or command execution, filesystem or document access","Permission surface: shell or command execution, filesystem or document access"]},"decision":{"readiness_score":69,"readiness_label":"Prototype first","headline":"Fallback candidate for Document processing","role":"Fallback candidate","primary_fit":"Document processing","best_for":["Document processing workflows","Claude Code teams","teams that value GitHub adoption signals"],"risks":["No OpenAgentSkill engagement data yet"],"next_steps":["Install it in a sandbox agent and run one Document processing task end to end.","Compare output quality, latency, and failure behavior against at least one alternative.","Promote it into production only after reviewing repository permissions, license, and maintenance signals."]},"platforms":["Python","Markdown","Claude Code"],"use_cases":[{"slug":"document-processing","title":"Document processing","url":"https://www.openagentskill.com/use-cases/document-processing"},{"slug":"github-automation","title":"GitHub automation","url":"https://www.openagentskill.com/use-cases/github-automation"},{"slug":"web-scraping","title":"Web scraping","url":"https://www.openagentskill.com/use-cases/web-scraping"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"}],"install":"npx skills add clemlesne/scrape-it-now","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx skills add clemlesne/scrape-it-now","description":"Use the registry command when your workflow supports the OpenAgentSkill installer.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"Scrape It Now\" agent skill from https://github.com/clemlesne/scrape-it-now. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"Scrape It Now\" as a Claude Code skill from https://github.com/clemlesne/scrape-it-now. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"Scrape It Now\" from https://github.com/clemlesne/scrape-it-now into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/clemlesne/scrape-it-now","github_repo":"clemlesne/scrape-it-now","version":"1.0.0","license":"Apache-2.0","updated_at":"2026-06-15T21:00:34.597713+00:00","canonical_key":"clemlesne/scrape-it-now","recommendation_reasons":["Useful GitHub adoption: 542 stars","Install handoff is available","Repository freshness signal is available"],"urls":{"web":"https://www.openagentskill.com/skills/clemlesne-scrape-it-now","api":"https://www.openagentskill.com/api/agent/skills/clemlesne-scrape-it-now","install_api":"https://www.openagentskill.com/api/skills/clemlesne-scrape-it-now/install","audit":"https://www.openagentskill.com/skills/clemlesne-scrape-it-now/audit","repository":"https://github.com/clemlesne/scrape-it-now"},"meta":{"endpoint":"/api/registry/manifest/{slug}","canonical_agent_endpoint":"/api/agent/skills/clemlesne-scrape-it-now","agent_friendly":true,"api_version":"1.0","generated_at":"2026-06-17T10:52:31.751Z"}}