Star200+

Scrape It Now

REVIEW · 66
Community indexed

Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.

Downloads0
Stars544
Version1.0.0
Quality67/100 · Promising
Trust66/100 · Sandbox only
Audit74/100 · Needs review

Supply asset profile

Research and knowledge work

Deep research, source comparison, literature review, RAG, knowledge search, and reports.

Browse track

Scenario

Document processing

I need my agent to read PDFs, extract tables, and turn documents into structured data.

Agent fit

Claude Code + CLI + Codex

Codex, Claude Code, Cursor, CLI, or custom agents.

Install

Ready

npx skills add clemlesne/scrape-it-now

Maintenance

stable

9mo since push

Risk

Needs review

Permission surface may require sandboxing

GitHub quality

544

67/100 Quality · 74/100 Trust

Coverage tags

ResearchDocument processingdocument-processingmarkdowndocuments

Review notes

Permission surface may require sandboxing · Quality score needs review

Agent adoption scorecard

Trust, audit, and install readiness at a glance

These scores combine public repository metadata, OpenAgentSkill review signals, maintenance freshness, and install readiness. They are a shortlist signal, not a replacement for human review.

Quality

Promising
67

Useful candidate, but compare it with alternatives before adopting.

Trust

Sandbox only
66

Useful candidate with missing or mixed trust signals. Keep it in an isolated workspace until the outcome loop proves task fit.

Audit

Needs review
74

A machine-readable review of install readiness, security metadata, maintenance, and adoption risk.

OpenAgentSkill Trust Score v5

Human review before install

Run only in a sandbox and compare close alternatives before using it for real work.

PythonMarkdownCodexClaude CodeCursor

Stars

544 GitHub stars

Repo activity

544 stars, 22 forks

Maintenance

9mo since push

License

Apache-2.0

Install

npx skills add clemlesne/scrape-it-now

Install safety

standard package or runtime install path

Permission surface

shell or command execution, filesystem or document access

Agent outcomes

No agent outcome data yet

Docs

Strong README/SKILL.md context

Risk summary

Review before production

  • Quality score needs review
  • Permission surface needs review: shell or command execution, filesystem or document access
  • Permission surface: shell or command execution, filesystem or document access

Install readiness

Install path available

  • Install path is available
  • Repository evidence is available
  • License is declared
  • No Agent Proven outcome evidence yet

Agent-readable metadata

Machine-readable decision data for this skill.

Use this block or the embedded JSON to decide whether an agent should install this skill, choose an alternative, or ask for human review first.

Open JSON

Suited tasks

  • Document processing workflows
  • Claude Code teams
  • teams that value GitHub adoption signals
  • Read uploaded files

Suited agents

PythonMarkdownCodexClaude CodeCursorOpenAgentSkill CLICLI

Install decision

Command
npx skills add clemlesne/scrape-it-now
Policy
review
Human review
yes

Trust and risk

Trust
66/100
Audit
74/100
Risk level
Needs review

Outcome loop

Endpoint
/api/agent/outcome
Event ID
resolve
Outcomes
5

Install command

npx skills add clemlesne/scrape-it-now
Public auditEval reportResolve APIInstall handoff

Do not use when

  • teams that need a vendor-supported SLA
  • high-compliance environments without internal security review
  • No major risk signals from current metadata
  • High-risk permission hints: Shell or command execution
  • Permission surface may require sandboxing

Alternative

Markitdown

156.1K Stars

npx skills add microsoft/markitdown

Alternative

PaddleOCR

83.1K Stars

npx skills add PaddlePaddle/PaddleOCR

Alternative

Stirling PDF

81.2K Stars

npx skills add Stirling-Tools/Stirling-PDF

Alternative

Tesseract

74.7K Stars

npx skills add tesseract-ocr/tesseract

Agent safety v2

46/100 · Avoid automatic install

Experimentalreview

Sparse or mixed signals. Useful for discovery, but not for autonomous installation.

Test manually in an isolated workspace and compare against safer alternatives.

Resolve via API

high

Shell or command execution

Skill metadata references terminal, CLI, shell, subprocess, or command execution workflows.

medium

Network access

Skill likely fetches remote pages, APIs, repositories, or external services.

medium

Filesystem access

Skill may read or write project files, documents, generated artifacts, or local workspace state.

  • High-risk permission hints: Shell or command execution
  • Permission surface may require sandboxing

Install targets

Install this skill in your agent workflow

Use the public install endpoint to fetch the command, safety checklist, target prompts, and canonical links for this skill.

skill install

OpenAgentSkill CLI

Use the registry command when your workflow supports the OpenAgentSkill installer.

$ npx skills add clemlesne/scrape-it-now

Agent resolve plan

Let an agent verify fit before installing.

The Resolve API returns the selected skill, alternatives, safety policy, audit notes, install target, and copy-paste prompt an agent can follow without scraping this page.

Open text plan

Open JSON

/api/agent/resolve?task=Use%20Scrape%20It%20Now%20for%20an%20agent%20workflow&agent=codex&max_risk=medium

Resolve text

/api/agent/resolve?task=Use%20Scrape%20It%20Now%20for%20an%20agent%20workflow&agent=codex&max_risk=medium&format=text

Install handoff

/api/skills/clemlesne-scrape-it-now/install

Agent should check

  • Task fit and alternatives from Resolve API.
  • Audit score, trust score, and safety policy warnings.
  • Install target compatibility for Codex, Claude Code, Cursor, or CLI.

Copy prompt

Task: Use Scrape It Now in this workspace.
Resolve first: https://www.openagentskill.com/api/agent/resolve?task=Use%20Scrape%20It%20Now%20for%20an%20agent%20workflow&agent=codex&max_risk=medium
Review install handoff: https://www.openagentskill.com/api/skills/clemlesne-scrape-it-now/install
Install command: npx skills add clemlesne/scrape-it-now
Before running it, summarize audit warnings, required permissions, and the fallback skill if install is risky.

Agent handoff

Give an agent the install path, not another directory page.

Use the public install endpoint to fetch the command, safety checklist, target prompts, and canonical links for this skill.

Open install API

Install handoff

/api/skills/clemlesne-scrape-it-now/install

LLM text format

/api/skills/clemlesne-scrape-it-now/install?format=text

Find alternatives

/api/skills/search?q=Scrape%20It%20Now&limit=3

Agent prompt

Use Scrape It Now for this task. Review https://www.openagentskill.com/api/skills/clemlesne-scrape-it-now/install, then install with: npx skills add clemlesne/scrape-it-now

Registry metadata

Agent-readable profile for automatic skill selection.

This page exposes the same decision, trust, audit, use-case, and install signals through the Registry API, so agents can rank this skill without scraping the UI.

Open manifest

Manifest

/api/registry/manifest/clemlesne-scrape-it-now

LLM text

/api/registry/manifest/clemlesne-scrape-it-now?format=text

Install alias

/api/registry/install/clemlesne-scrape-it-now

Recommend

/api/registry/recommend?task=Use%20Scrape%20It%20Now%20in%20an%20agent%20workflow&limit=3

Agent fit

70/100

Document processing

Use-case tags

Document processingGitHub automationWeb scraping

Platforms

Python, Markdown, Claude Code

Audit report

Needs review · 74/100

A machine-readable review of install readiness, security metadata, maintenance, and adoption risk.

View audit reportView eval report

Agent decision cockpit

Fallback candidate for Document processing

Prototype with this skill first; keep a fallback candidate ready.

70
Readiness
Prototype
Stage

Role in stack

Fallback candidate

Primary fit

Document processing

Trust label

Prototype first

Install path

Command ready

Use when

  • Document processing workflows
  • Claude Code teams
  • teams that value GitHub adoption signals

Evidence

  • 544 GitHub stars
  • install command or GitHub repo available
  • 67/100 quality profile
  • 3 OpenAgentSkill engagement events

review first

  • No major risk signals from current metadata

Implementation path

  1. 1Install it in a sandbox agent and run one Document processing task end to end.
  2. 2Compare output quality, latency, and failure behavior against at least one alternative.
  3. 3Promote it into production only after reviewing repository permissions, license, and maintenance signals.

Trust profile

Sandbox only

Useful candidate with missing or mixed trust signals. Keep it in an isolated workspace until the outcome loop proves task fit.

66
OpenAgentSkill Trust Score

GitHub adoption

INFO

544 GitHub stars

Stars/forks activity

INFO

544 stars, 22 forks; issue activity unavailable in current metadata

Recent maintenance

INFO

9mo since push

License clarity

PASS

Apache-2.0

Good signals

  • AI review approved
  • Install path is available
  • Repository evidence is available
  • Meaningful GitHub adoption signal
  • Install command has no obvious high-risk pattern
  • Outcome loop is ready but needs first real agent run

Review before install

  • Quality score needs review
  • Permission surface needs review: shell or command execution, filesystem or document access
  • Permission surface: shell or command execution, filesystem or document access
  • No real agent outcome reports yet
  • Human review required before unattended installation

Recommended action

Run only in a sandbox and compare close alternatives before using it for real work.

Quality profile

Promising candidate for agent workflows

Useful candidate, but compare it with alternatives before adopting.

67
GitHub stars
544
Freshness
9mo ago
Install ready
Yes
License
Apache-2.0

Workflow fit

Use this skill in these scenarios

Parse messy files

Document processing

I need my agent to read PDFs, extract tables, and turn documents into structured data.

Manage repositories

GitHub automation

I need my agent to triage GitHub issues, review pull requests, and summarize repository changes.

Collect structured data

Web scraping

I need my agent to scrape websites and extract structured data from pages.

Workflow fit

Add it to a complete workflow

Scrape, clean, and reuse web data

Web data pipeline

A practical workflow for agents that crawl public pages, extract clean content, normalize data, and hand it to downstream research or RAG workflows.

Turn skills into distribution

Content growth agent

A workflow for turning newly indexed skills into SEO briefs, social drafts, comparison pages, and reusable publishing workflows.

Inspect, patch, and verify code

Coding review agent

A workflow for software agents that inspect repositories, review pull requests, generate tests, and turn findings into shippable patches.

Alternative shortlist

Compare before you install

Similar skills that may fit this task.

Compare all

Markitdown

Python tool for converting files and office documents to Markdown.

Adopt
Ready100
Quality100
Stars156.1K

PaddleOCR

Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.

Adopt
Ready100
Quality100
Stars83.1K

Stirling PDF

#1 PDF Application on GitHub that lets you edit PDFs on any device anywhere

Adopt
Ready100
Quality100
Stars81.2K

Tesseract

Tesseract Open Source OCR Engine (main repository)

Adopt
Ready100
Quality100
Stars74.7K

Overview

Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.

Imported by the skill-only GitHub discovery pipeline because it matches agent skill, automation, domain workflow, RAG, document-processing, data, finance, security, or developer-tool signals. Protocol-server projects are excluded from automated imports.

Platform compatibility

pythonFULL
markdownFULL

Technical details

Version
1.0.0
License
Apache-2.0
Last updated
Jul 19, 2026
Published
Jun 13, 2026

Frameworks & tools

PythonMarkdown

Decision snapshot

Fallback candidate

70
Ready
Prototype
Stage

544 GitHub stars

Audit

Install review

Install and adoption review

74
Needs review
Security
82/100
Maintenance
62/100
Install
92/100
Open full auditView eval report

Agent-proven evidence

Agent-proven evidence

Outcome reports after resolve, review, install, and one narrow run.

0
Proven
Needs first agent runAuto-install: review firstLast: Unknown
Success rate
—
Recent failure
—
Outcomes
0
Output quality
—
Failed
0
Not relevant
0
Installs
0
Risk blocked
0
Setup needed
0
Production
0

No agent outcome data yet. The first agent run can report success, setup needs, risk blocks, failure, or not-relevant through /api/agent/outcome.

Agent-Proven rankingOutcome contract

Install

Add to agent workflow

Free and open source. Review the report before installing into production agents.

Compare AlternativesAuto-resolve PlanView on GitHubDocumentation

Growth loop

Share kit

X

Scenario-led draft for Scrape It Now, ready for a manual X post.

Curator note
Scrape It Now: Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and...

544 stars

https://www.openagentskill.com/skills/clemlesne-scrape-it-now?ref=x
Open X draft
Optional reply with install command
Listing + install path for Scrape It Now:
https://www.openagentskill.com/skills/clemlesne-scrape-it-now?ref=x

Install: npx skills add clemlesne/scrape-it-now
Open reply draft

Listing source

Community indexed

Claimable

This listing was indexed from public sources and is not marked official until a maintainer claim is approved.

Creator
clemlesne
Indexed by
OpenAgentSkill community index

Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals.

Claim this skill

Owner claim

Claim this skill listing

This Community indexed listing is attributed to clemlesne but is not marked official yet. Claim it to add a verified owner signal and make future launch, install, and audit updates easier to trust.

Creator backlink kit

Add the evidence badges to your README

Show the canonical listing, current trust and audit signals, and real Agent-Proven evidence where developers evaluate the repository.

[![Listed on OpenAgentSkill](https://www.openagentskill.com/api/badge/clemlesne-scrape-it-now?metric=listed&label=Listed)](https://www.openagentskill.com/skills/clemlesne-scrape-it-now)
[![OpenAgentSkill Trust](https://www.openagentskill.com/api/badge/clemlesne-scrape-it-now?metric=trust&label=Trust)](https://www.openagentskill.com/skills/clemlesne-scrape-it-now)
[![OpenAgentSkill Audit](https://www.openagentskill.com/api/badge/clemlesne-scrape-it-now?metric=audit&label=Audit)](https://www.openagentskill.com/skills/clemlesne-scrape-it-now/audit)
[![Agent Proven](https://www.openagentskill.com/api/badge/clemlesne-scrape-it-now?metric=proven&label=Agent%20Proven)](https://www.openagentskill.com/skills/clemlesne-scrape-it-now)
Preview badge Open audit Creator kit

Author

C

clemlesne

@clemlesne

Tags

markdowndocumentsaiazurecliscraperpythongithub

Platform fit

Claude Code

Health signals

GitHub stars
544
Quality score
42/100
Last GitHub push
Nov 3, 2025
Framework hints
2
OpenAgentSkill views
3
Install copies
0
Outbound clicks
0

Community signal

Share whether this skill looks useful for your agent workflow. Aggregated feedback improves rankings over time.

Trust & safety

Sandbox only

66
  • GitHub adoption544 GitHub starsINFO
  • Stars/forks activity544 stars, 22 forks; issue activity unavailable in current metadataINFO
  • Recent maintenance9mo since pushINFO
  • License clarityApache-2.0PASS
  • README/SKILL.md completenessMetadata includes enough usage and workflow contextPASS
  • Dependency/runtime riskcommand execution surface, network or browser surfaceINFO

Related skills

Markitdown

Python tool for converting files and office documents to Markdown.

156.1K Stars · 0 Installs

PaddleOCR

Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.

83.1K Stars · 0 Installs

Stirling PDF

#1 PDF Application on GitHub that lets you edit PDFs on any device anywhere

81.2K Stars · 0 Installs

Tesseract

Tesseract Open Source OCR Engine (main repository)

74.7K Stars · 0 Installs