OpenAgentSkillRegistry
ResolveSkillsTasksPacksCompareAPIDocs
Star0Submit Skill
Star0
Skills/web-automation/Grab Site

Grab Site

REVIEW · 70
Community indexed

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

Downloads0
Stars1.6K
Version1.0.0
Quality67/100 · Promising
Trust70/100 · Sandbox only
Audit71/100 · Needs review

Supply asset profile

Research and knowledge work

Deep research, source comparison, literature review, RAG, knowledge search, and reports.

Browse track

Scenario

RAG and knowledge

I need my agent to build a RAG workflow over documents and retrieve reliable context.

Agent fit

Claude Code + CLI + Codex

Codex, Claude Code, Cursor, CLI, or custom agents.

Install

Ready

npx skills add ArchiveTeam/grab-site

Maintenance

stale

1y since push

Risk

Needs review

License is unclear

GitHub quality

1.6K

67/100 quality · 78/100 trust

Coverage tags

ResearchRAG and knowledgeweb-automationcrawlerdata-extraction

Review notes

License is unclear · Repository appears stale

Agent adoption scorecard

Trust, audit, and install readiness at a glance

These scores combine public repository metadata, OpenAgentSkill review signals, maintenance freshness, and install readiness. They are a shortlist signal, not a replacement for human review.

Quality

Promising
67

Useful candidate, but compare it with alternatives before adopting.

Trust

Sandbox only
70

Useful candidate with missing or mixed trust signals. Keep it in an isolated workspace until the outcome loop proves task fit.

Audit

Needs review
71

Install readiness, security metadata, maintenance, and adoption risk.

Trust Score v5

Human review before install

Run only in a sandbox and compare close alternatives before using it for real work.

PythonCrawlerCodexClaude CodeCursor

Stars

1.6K GitHub stars

Repo activity

1.6K stars, 156 forks

Maintenance

1y since push

License

Unknown

Install

npx skills add ArchiveTeam/grab-site

Install safety

standard package or runtime install path

Permission surface

filesystem or document access, network or browser access

Agent outcomes

No agent outcome data yet

Docs

Strong README/SKILL.md context

Risk summary

Review before production

  • License is unclear
  • Repository looks stale
  • Quality score needs review
  • Recent maintenance: 1y since push

Install readiness

Install path available

  • Install path is available
  • Repository evidence is available
  • License is unclear
  • No Agent Proven outcome evidence yet

Agent-readable metadata

Machine-readable decision data for this skill.

Use this block or the embedded JSON to decide whether an agent should install this skill, choose an alternative, or ask for human review first.

Open JSON

Suited tasks

  • Web scraping workflows
  • Claude Code teams
  • teams that value GitHub adoption signals
  • Crawl target URLs

Suited agents

PythonCrawlerCodexClaude CodeCursorOpenAgentSkill CLICLI

Install decision

Command
npx skills add ArchiveTeam/grab-site
Policy
review
Human review
yes

Trust and risk

Trust
70/100
Audit
71/100
Risk level
Needs review

Outcome loop

Endpoint
/api/agent/outcome
Event ID
resolve
Outcomes
5

Install command

npx skills add ArchiveTeam/grab-site
Public auditEval reportResolve APIInstall handoff

Do not use when

  • teams that require actively maintained dependencies
  • production agents without a repository review
  • Repository looks stale
  • License is unclear
  • Repository appears stale

Alternative

Crawl4AI

73.1K stars

npx skills add unclecode/crawl4ai

Alternative

Scrapling

70.0K stars

npx skills add D4Vinci/Scrapling

Alternative

Scrapy

62.5K stars

npx skills add scrapy/scrapy

Alternative

EasySpider

44.1K stars

npx skills add NaiboWang/EasySpider

Agent safety v2

55/100 · Review before install

Experimentalreview

Sparse or mixed signals. Useful for discovery, but not for autonomous installation.

Test manually in an isolated workspace and compare against safer alternatives.

Resolve via API

medium

Network access

Skill likely fetches remote pages, APIs, repositories, or external services.

medium

Filesystem access

Skill may read or write project files, documents, generated artifacts, or local workspace state.

  • License is unclear

Install targets

Install this skill in your agent workflow

Copy the registry command or an agent-specific install prompt for Codex, Claude Code, and Cursor.

skill install

OpenAgentSkill CLI

Use the registry command when your workflow supports the OpenAgentSkill installer.

$ npx skills add ArchiveTeam/grab-site

Agent resolve plan

Let an agent verify fit before installing.

The Resolve API returns the selected skill, alternatives, safety policy, audit notes, install target, and copy-paste prompt an agent can follow without scraping this page.

Open text plan

Resolve JSON

/api/agent/resolve?task=Use%20Grab%20Site%20for%20an%20agent%20workflow&agent=codex&max_risk=medium

Resolve text

/api/agent/resolve?task=Use%20Grab%20Site%20for%20an%20agent%20workflow&agent=codex&max_risk=medium&format=text

Install handoff

/api/skills/archiveteam-grab-site/install

Agent should check

  • Task fit and alternatives from Resolve API.
  • Audit score, trust score, and safety policy warnings.
  • Install target compatibility for Codex, Claude Code, Cursor, or CLI.

Copy prompt

Task: Use Grab Site in this workspace.
Resolve first: https://www.openagentskill.com/api/agent/resolve?task=Use%20Grab%20Site%20for%20an%20agent%20workflow&agent=codex&max_risk=medium
Review install handoff: https://www.openagentskill.com/api/skills/archiveteam-grab-site/install
Install command: npx skills add ArchiveTeam/grab-site
Before running it, summarize audit warnings, required permissions, and the fallback skill if install is risky.

Agent handoff

Give an agent the install path, not another directory page.

Use the public install endpoint to fetch the command, safety checklist, target prompts, and canonical links for this skill.

Open install API

Install handoff

/api/skills/archiveteam-grab-site/install

LLM text format

/api/skills/archiveteam-grab-site/install?format=text

Find alternatives

/api/skills/search?q=Grab%20Site&limit=3

Agent prompt

Use Grab Site for this task. Review https://www.openagentskill.com/api/skills/archiveteam-grab-site/install, then install with: npx skills add ArchiveTeam/grab-site

Registry metadata

Agent-readable profile for automatic skill selection.

This page exposes the same decision, trust, audit, use-case, and install signals through the Registry API, so agents can rank this skill without scraping the UI.

Open manifest

Manifest

/api/registry/manifest/archiveteam-grab-site

LLM text

/api/registry/manifest/archiveteam-grab-site?format=text

Install alias

/api/registry/install/archiveteam-grab-site

Recommend

/api/registry/recommend?task=Use%20Grab%20Site%20in%20an%20agent%20workflow&limit=3

Agent fit

70/100

Web scraping

Use-case tags

Web scrapingSports analyticsCoding agents

Platforms

Python, Crawler, Claude Code

Audit report

Needs review · 71/100

Review install readiness, maintenance, trust, quality, and metadata warnings before adding this skill to an agent workflow.

View audit reportView eval report

Agent decision cockpit

Fallback candidate for Web scraping

Prototype with this skill first; keep a fallback candidate ready.

70
Readiness
Prototype
Stage

Role in stack

Fallback candidate

Primary fit

Web scraping

Trust label

Prototype first

Install path

Command ready

Use when

  • Web scraping workflows
  • Claude Code teams
  • teams that value GitHub adoption signals

Evidence

  • 1,584 GitHub stars
  • install command or GitHub repo available
  • 67/100 quality profile
  • 3 OpenAgentSkill engagement events

Review first

  • Repository looks stale

Implementation path

  1. 1Install it in a sandbox agent and run one Web scraping task end to end.
  2. 2Compare output quality, latency, and failure behavior against at least one alternative.
  3. 3Promote it into production only after reviewing repository permissions, license, and maintenance signals.

Trust profile

Sandbox only

Useful candidate with missing or mixed trust signals. Keep it in an isolated workspace until the outcome loop proves task fit.

70
Trust score

GitHub adoption

PASS

1.6K GitHub stars

Stars/forks activity

INFO

1.6K stars, 156 forks; issue activity unavailable in current metadata

Recent maintenance

FIX

1y since push

License clarity

CHECK

Unknown

Good signals

  • Manually verified listing
  • AI review approved
  • Install path is available
  • Repository evidence is available
  • Meaningful GitHub adoption signal
  • Install command has no obvious high-risk pattern
  • Outcome loop is ready but needs first real agent run

Review before install

  • License is unclear
  • Repository looks stale
  • Quality score needs review
  • Recent maintenance: 1y since push
  • License clarity: Unknown
  • No real agent outcome reports yet
  • Human review required before unattended installation

Recommended action

Run only in a sandbox and compare close alternatives before using it for real work.

Quality profile

Promising candidate for agent workflows

Useful candidate, but compare it with alternatives before adopting.

67
GitHub stars
1.6K
Freshness
1y ago
Install ready
Yes
License
Unknown
Check before install: Repository looks stale

Workflow fit

Use this skill in these scenarios

Collect structured data

Web scraping

I need my agent to scrape websites and extract structured data from pages.

Analyze matches

Sports analytics

I need my agent to analyze football matches, World Cup data, xG, players, teams, and predictions.

Build and ship code

Coding agents

I need a coding agent that can understand a repository, edit code, and review pull requests.

Stack fit

Add it to a complete workflow

Scrape, clean, and reuse web data

Web data pipeline

A practical stack for agents that crawl public pages, extract clean content, normalize data, and hand it to downstream research or RAG workflows.

Turn skills into distribution

Content growth agent

A stack for turning newly indexed skills into SEO briefs, social drafts, comparison pages, and reusable publishing workflows.

Inspect, patch, and verify code

Coding review agent

A stack for software agents that inspect repositories, review pull requests, generate tests, and turn findings into shippable patches.

Alternative shortlist

Compare before you install

Similar skills in this category, ranked with the same readiness and quality signals.

Compare all

Crawl4AI

Open-source LLM-friendly web crawler and scraper

Adopt
Ready100
Quality100
Stars73.1K

Scrapling

Adaptive web scraping for agent data collection

Adopt
Ready100
Quality100
Stars70.0K

Scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

Adopt
Ready100
Quality100
Stars62.5K

EasySpider

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。

Adopt
Ready100
Quality100
Stars44.1K

Overview

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

Imported by the skill-only GitHub discovery pipeline because it matches agent skill, automation, domain workflow, RAG, document-processing, data, finance, security, or developer-tool signals. Protocol-server projects are excluded from automated imports.

Platform Compatibility

pythonFULL
crawlerFULL

Technical Details

Version
1.0.0
License
Unknown
Last Updated
6/13/2026
Published
5/23/2026

Frameworks & Tools

PythonCrawler

Decision snapshot

Fallback candidate

70
Ready
Prototype
Stage

1,584 GitHub stars

Audit snapshot

Install review

Install and adoption review

71
Needs review
Security
80/100
Maintenance
38/100
Install
92/100
Open full auditOpen eval report

Agent-proven evidence

Agent Proven evidence

Outcome reports after resolve, review, install, and one narrow run.

0
Proven
Needs first agent runAuto-install: review firstLast: Unknown
Success rate
—
Recent failure
—
Outcomes
0
Output quality
—
Failed
0
Not relevant
0
Installs
0
Risk blocked
0
Setup needed
0
Production
0

No agent outcome data yet. The first agent run can report success, setup needs, risk blocks, failure, or not-relevant through /api/agent/outcome.

Agent-Proven rankingOutcome contract

Install

Add to agent workflow

Free and open source. Review the audit before production use.

Compare AlternativesAuto-resolve PlanView on GitHubDocumentation

Growth loop

Share kit

X

Scenario-led draft for Grab Site, ready for a manual X post.

Curator note
Most web agents fail in the boring part: messy pages, missing context, repeatable extraction.

Grab Site gives agents a cleaner path to browse, extract, and monitor web pages.

1.6K stars

https://www.openagentskill.com/skills/archiveteam-grab-site?ref=x
#AIAgents
Open X draft
Optional reply with install command
Listing + install path for Grab Site:
https://www.openagentskill.com/skills/archiveteam-grab-site?ref=x

Install: npx skills add ArchiveTeam/grab-site
Open reply draft

Listing source

Community indexed

Claimable

This listing was indexed from public sources and is not marked official until a maintainer claim is approved.

Creator
ArchiveTeam
Source
ArchiveTeam/grab-site
Indexed by
OpenAgentSkill community index

Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals.

Claim this skill

Owner claim

Claim this skill listing

This community indexed listing is attributed to ArchiveTeam but is not marked official yet. Claim it to add a verified owner signal and make future launch, install, and audit updates easier to trust.

Creator backlink kit

Add the evidence badges to your README

Show the canonical listing, current trust and audit signals, and real Agent Proven evidence where developers evaluate the repository.

[![Listed on OpenAgentSkill](https://www.openagentskill.com/api/badge/archiveteam-grab-site?metric=listed&label=Listed)](https://www.openagentskill.com/skills/archiveteam-grab-site)
[![OpenAgentSkill Trust](https://www.openagentskill.com/api/badge/archiveteam-grab-site?metric=trust&label=Trust)](https://www.openagentskill.com/skills/archiveteam-grab-site)
[![OpenAgentSkill Audit](https://www.openagentskill.com/api/badge/archiveteam-grab-site?metric=audit&label=Audit)](https://www.openagentskill.com/skills/archiveteam-grab-site/audit)
[![Agent Proven](https://www.openagentskill.com/api/badge/archiveteam-grab-site?metric=proven&label=Agent%20Proven)](https://www.openagentskill.com/skills/archiveteam-grab-site)
Preview badge Open audit Creator Kit

Author

A

ArchiveTeam✓

@archiveteam

Tags

crawlerdata-extractionarchivingcrawlspiderwarcpythongithub

Platform Fit

Claude Code

Health Signals

GitHub stars
1.6K
Quality score
49/100
Last GitHub push
May 23, 2025
Framework hints
2
OpenAgentSkill views
1
Install copies
0
Outbound clicks
0

Community Signal

Share whether this skill looks useful for your agent workflow. Aggregated feedback improves rankings over time.

Trust & Safety

Sandbox only

70
  • GitHub adoption1.6K GitHub starsPASS
  • Stars/forks activity1.6K stars, 156 forks; issue activity unavailable in current metadataINFO
  • Recent maintenance1y since pushFIX
  • License clarityUnknownCHECK
  • README/SKILL.md completenessMetadata includes enough usage and workflow contextPASS
  • Dependency/runtime risknetwork or browser surfacePASS

Related Skills

Crawl4AI

Open-source LLM-friendly web crawler and scraper

73.1K stars · 31.0K installs

Scrapling

Adaptive web scraping for agent data collection

70.0K stars · 0 installs

Scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

62.5K stars · 0 installs

EasySpider

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。

44.1K stars · 0 installs
OpenAgentSkill

The skill layer for AI agents: discover, compare, audit, and install reusable capabilities across Codex, Claude Code, Cursor, and agent runtimes.

GitHubX

Explore

SkillsAgent SkillsWhat Is an Agent Skill?AI Agent SkillsTasksSkill PacksBest SkillsTrendingStacksUse CasesAgentsAgent Entry

Trust

CompareSafety GateSkills RegistryRankingsOutcomesAuditsOfficialWeekly ReportsMonthly IndexState of Agent Skillsvs skills.shAgentSkills.io Alternative

Build

DocsAbout OpenAgentSkillAPIllms.txtOpenAPICLICreator KitX Growth KitSubmitBlogGuidesActivity
OpenAgentSkill Registry
PrivacyBuilt for agent-native discovery