LxSpider

REVIEW · 75

Community indexed

爬虫案例合集。包括但不限于《淘宝、京东、天猫、豆瓣、抖音、快手、微博、微信、阿里、头条、pdd、优酷、爱奇艺、携程、12306、58、搜狐、各种指数、维普万方、Zlibraty、Oalib、小说、招标网、采购网、小红书、大众点评、推特、脉脉、知乎》

Downloads0

Stars1.9K

Version1.0.0

Quality73/100 · Strong

Trust75/100 · Sandbox only

Audit74/100 · Needs review

Supply asset profile

Coding and developer agents

Code review, repo analysis, testing, CI, GitHub, DevOps, and developer workflow skills.

Browse track

Scenario

Coding agents

I need a coding agent that can understand a repository, edit code, and review pull requests.

Agent fit

Claude Code + CLI + Codex

Codex, Claude Code, Cursor, CLI, or custom agents.

Install

Ready

npx skills add lixi5338619/lxSpider

Maintenance

stale

2y since push

Risk

Needs review

Repository appears stale

GitHub quality

1.9K

73/100 quality · 83/100 trust

Coverage tags

CodingCoding agentsweb-automationcrawlerdata-extraction

Review notes

Repository appears stale · Repository looks stale

Agent adoption scorecard

Trust, audit, and install readiness at a glance

These scores combine public repository metadata, OpenAgentSkill review signals, maintenance freshness, and install readiness. They are a shortlist signal, not a replacement for human review.

Quality

Strong

Solid option that is likely worth shortlisting for production workflows.

Trust

Sandbox only

Useful candidate with missing or mixed trust signals. Keep it in an isolated workspace until the outcome loop proves task fit.

Audit

Needs review

Install readiness, security metadata, maintenance, and adoption risk.

Trust Score v5

Human review before install

Run only in a sandbox and compare close alternatives before using it for real work.

PythonCrawlerCodexClaude CodeCursor

Stars

1.9K GitHub stars

Repo activity

1.9K stars, 460 forks

Maintenance

2y since push

License

GPL-3.0

Install

npx skills add lixi5338619/lxSpider

Install safety

standard package or runtime install path

Permission surface

no high-risk permission surface in public metadata

Agent outcomes

No agent outcome data yet

Docs

Strong README/SKILL.md context

Risk summary

Review before production

Repository looks stale
Quality score needs review
Recent maintenance: 2y since push

Install readiness

Install path available

Install path is available
Repository evidence is available
License is declared
No Agent Proven outcome evidence yet

Agent-readable metadata

Machine-readable decision data for this skill.

Use this block or the embedded JSON to decide whether an agent should install this skill, choose an alternative, or ask for human review first.

Open JSON

Suited tasks

Web scraping workflows
Claude Code teams
teams that value GitHub adoption signals
Crawl target URLs

Suited agents

PythonCrawlerCodexClaude CodeCursorOpenAgentSkill CLICLI

Install decision

Command: npx skills add lixi5338619/lxSpider
Policy: review
Human review: yes

Trust and risk

Trust: 75/100
Audit: 74/100
Risk level: Needs review

Outcome loop

Endpoint: /api/agent/outcome
Event ID: resolve
Outcomes: 5

Install command

npx skills add lixi5338619/lxSpider

Public audit Eval report Resolve API Install handoff

Do not use when

teams that require actively maintained dependencies
production agents without a repository review
Repository looks stale
Repository appears stale
Quality score needs review

Alternative

Crawl4AI

71.1K stars

npx skills add unclecode/crawl4ai

Alternative

Scrapling

68.3K stars

npx skills add D4Vinci/Scrapling

Alternative

Scrapy

62.5K stars

npx skills add scrapy/scrapy

Alternative

EasySpider

44.1K stars

npx skills add NaiboWang/EasySpider

Agent safety v2

62/100 · Review before install

Reviewed with permission notesreview

Usable candidate, but the agent should surface permission and audit notes before installation.

Require human approval before installing into a real workspace.

Resolve via API

medium

Network access

Skill likely fetches remote pages, APIs, repositories, or external services.

Repository appears stale

Install targets

Install this skill in your agent workflow

Copy the registry command or an agent-specific install prompt for Codex, Claude Code, and Cursor.

skill install

OpenAgentSkill CLI

Use the registry command when your workflow supports the OpenAgentSkill installer.

$ npx skills add lixi5338619/lxSpider

Agent resolve plan

Let an agent verify fit before installing.

The Resolve API returns the selected skill, alternatives, safety policy, audit notes, install target, and copy-paste prompt an agent can follow without scraping this page.

Open text plan

Resolve JSON

/api/agent/resolve?task=Use%20LxSpider%20for%20an%20agent%20workflow&agent=codex&max_risk=medium

Resolve text

/api/agent/resolve?task=Use%20LxSpider%20for%20an%20agent%20workflow&agent=codex&max_risk=medium&format=text

Install handoff

/api/skills/lixi5338619-lxspider/install

Agent should check

Task fit and alternatives from Resolve API.
Audit score, trust score, and safety policy warnings.
Install target compatibility for Codex, Claude Code, Cursor, or CLI.

Copy prompt

Task: Use LxSpider in this workspace.
Resolve first: https://www.openagentskill.com/api/agent/resolve?task=Use%20LxSpider%20for%20an%20agent%20workflow&agent=codex&max_risk=medium
Review install handoff: https://www.openagentskill.com/api/skills/lixi5338619-lxspider/install
Install command: npx skills add lixi5338619/lxSpider
Before running it, summarize audit warnings, required permissions, and the fallback skill if install is risky.

Agent handoff

Give an agent the install path, not another directory page.

Use the public install endpoint to fetch the command, safety checklist, target prompts, and canonical links for this skill.

Open install API

Install handoff

/api/skills/lixi5338619-lxspider/install

LLM text format

/api/skills/lixi5338619-lxspider/install?format=text

Find alternatives

/api/skills/search?q=LxSpider&limit=3

Agent prompt

Use LxSpider for this task. Review https://www.openagentskill.com/api/skills/lixi5338619-lxspider/install, then install with: npx skills add lixi5338619/lxSpider

Registry metadata

Agent-readable profile for automatic skill selection.

This page exposes the same decision, trust, audit, use-case, and install signals through the Registry API, so agents can rank this skill without scraping the UI.

Open manifest

Manifest

/api/registry/manifest/lixi5338619-lxspider

LLM text

/api/registry/manifest/lixi5338619-lxspider?format=text

Install alias

/api/registry/install/lixi5338619-lxspider

Recommend

/api/registry/recommend?task=Use%20LxSpider%20in%20an%20agent%20workflow&limit=3

Agent fit

77/100

Web scraping

Use-case tags

Web scraping Coding agents Sports analytics

Platforms

Python, Crawler, Claude Code

Audit report

Needs review · 74/100

Review install readiness, maintenance, trust, quality, and metadata warnings before adding this skill to an agent workflow.

View audit report View eval report

Agent decision cockpit

Companion skill for Web scraping

Shortlist this skill and compare it with close alternatives before production adoption.

Readiness

Shortlist

Stage

Role in stack

Companion skill

Primary fit

Web scraping

Trust label

Strong shortlist

Install path

Command ready

Use when

Web scraping workflows
Claude Code teams
teams that value GitHub adoption signals

Evidence

1,950 GitHub stars
install command or GitHub repo available
73/100 quality profile
4 OpenAgentSkill engagement events

Review first

Repository looks stale

Implementation path

1Install it in a sandbox agent and run one Web scraping task end to end.
2Compare output quality, latency, and failure behavior against at least one alternative.
3Promote it into production only after reviewing repository permissions, license, and maintenance signals.

Trust profile

Sandbox only

Useful candidate with missing or mixed trust signals. Keep it in an isolated workspace until the outcome loop proves task fit.

Trust score

GitHub adoption

PASS

1.9K GitHub stars

Stars/forks activity

PASS

1.9K stars, 460 forks; issue activity unavailable in current metadata

Recent maintenance

FIX

2y since push

License clarity

PASS

GPL-3.0

Good signals

Manually verified listing
AI review approved
Install path is available
Repository evidence is available
Meaningful GitHub adoption signal
Install command has no obvious high-risk pattern
Outcome loop is ready but needs first real agent run

Review before install

Repository looks stale
Quality score needs review
Recent maintenance: 2y since push
No real agent outcome reports yet
Human review required before unattended installation

Recommended action

Run only in a sandbox and compare close alternatives before using it for real work.

Quality profile

Strong candidate for agent workflows

Solid option that is likely worth shortlisting for production workflows.

GitHub stars

1.9K

Freshness

2y ago

Install ready

Yes

License

GPL-3.0

Check before install: Repository looks stale

Workflow fit

Use this skill in these scenarios

Collect structured data

Web scraping

I need my agent to scrape websites and extract structured data from pages.

Build and ship code

Coding agents

I need a coding agent that can understand a repository, edit code, and review pull requests.

Analyze matches

Sports analytics

I need my agent to analyze football matches, World Cup data, xG, players, teams, and predictions.

Stack fit

Add it to a complete workflow

Scrape, clean, and reuse web data

Web data pipeline

A practical stack for agents that crawl public pages, extract clean content, normalize data, and hand it to downstream research or RAG workflows.

Inspect, patch, and verify code

Coding review agent

A stack for software agents that inspect repositories, review pull requests, generate tests, and turn findings into shippable patches.

Turn skills into distribution

Content growth agent

A stack for turning newly indexed skills into SEO briefs, social drafts, comparison pages, and reusable publishing workflows.

Alternative shortlist

Compare before you install

Similar skills in this category, ranked with the same readiness and quality signals.

Compare all

Crawl4AI

Open-source LLM-friendly web crawler and scraper

Scrapling

Adaptive web scraping for agent data collection

Scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

EasySpider

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。

Overview

Imported by the skill-only GitHub discovery pipeline because it matches agent skill, automation, RAG, or developer-tool signals. Protocol-server projects are excluded from automated imports.

Platform Compatibility

pythonFULL

crawlerFULL

Technical Details

Version: 1.0.0
License: GPL-3.0
Last Updated: 6/14/2026
Published: 5/23/2026

Frameworks & Tools

PythonCrawler

Decision snapshot

Companion skill

Ready

Shortlist

Stage

1,950 GitHub stars

Audit snapshot

Install review

Install and adoption review

Needs review

Security: 90/100
Maintenance: 20/100
Install: 92/100

Open full audit Open eval report

Agent-proven evidence

Agent Proven evidence

Outcome reports after resolve, review, install, and one narrow run.

Proven

Needs first agent runAuto-install: review firstLast: Unknown

Success rate: —
Recent failure: —
Outcomes: 0
Output quality: —
Failed: 0
Not relevant: 0
Installs: 0
Risk blocked: 0
Setup needed: 0
Production: 0

No agent outcome data yet. The first agent run can report success, setup needs, risk blocks, failure, or not-relevant through /api/agent/outcome.

Agent-Proven ranking Outcome contract

Install

Add to agent workflow

Free and open source. Review the audit before production use.

Compare Alternatives Auto-resolve Plan View on GitHub Documentation

Growth loop

Share kit

Scenario-led draft for LxSpider, ready for a manual X post.

Curator note

Most web agents fail in the boring part: messy pages, missing context, repeatable extraction.

LxSpider gives agents a cleaner path to browse, extract, and monitor web pages.

1.9K stars

https://www.openagentskill.com/skills/lixi5338619-lxspider?ref=x
#AIAgents

Open X draft

Optional reply with install command

Listing + install path for LxSpider:
https://www.openagentskill.com/skills/lixi5338619-lxspider?ref=x

Install: npx skills add lixi5338619/lxSpider

Open reply draft

Listing source

Community indexed

Claimable

This listing was indexed from public sources and is not marked official until a maintainer claim is approved.

Creator: lixi5338619
Source: lixi5338619/lxSpider
Indexed by: OpenAgentSkill community index

Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals.

Claim this skill

Owner claim

Claim this skill listing

This community indexed listing is attributed to lixi5338619 but is not marked official yet. Claim it to add a verified owner signal and make future launch, install, and audit updates easier to trust.

README badge

Add this badge to your GitHub README to show the listing, trust score, and install handoff.

[![OpenAgentSkill](https://www.openagentskill.com/api/badge/lixi5338619-lxspider)](https://www.openagentskill.com/skills/lixi5338619-lxspider)

Preview badge Audit badge

Author

lixi5338619✓

@lixi5338619

Platform Fit

Claude Code

Health Signals

GitHub stars: 1.9K
Quality score: 50/100
Last GitHub push: May 9, 2024
Framework hints: 2
OpenAgentSkill views: 2
Install copies: 0
Outbound clicks: 0

Community Signal

Share whether this skill looks useful for your agent workflow. Aggregated feedback improves rankings over time.

Trust & Safety

Sandbox only

GitHub adoption1.9K GitHub starsPASS
Stars/forks activity1.9K stars, 460 forks; issue activity unavailable in current metadataPASS
Recent maintenance2y since pushFIX
License clarityGPL-3.0PASS
README/SKILL.md completenessMetadata includes enough usage and workflow contextPASS
Dependency/runtime riskno major dependency risk hints in public metadataPASS

Related Skills

Crawl4AI

Open-source LLM-friendly web crawler and scraper

71.1K stars · 31.0K installs

Scrapling

Adaptive web scraping for agent data collection

68.3K stars · 0 installs

Scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

62.5K stars · 0 installs

EasySpider

44.1K stars · 0 installs

LxSpider

Coding and developer agents

Trust, audit, and install readiness at a glance

Human review before install

Review before production

Install path available

Machine-readable decision data for this skill.

Crawl4AI

Scrapling

Scrapy

EasySpider

62/100 · Review before install

Network access

Install this skill in your agent workflow

OpenAgentSkill CLI

Let an agent verify fit before installing.

Give an agent the install path, not another directory page.

Agent-readable profile for automatic skill selection.

Needs review · 74/100

Companion skill for Web scraping

Sandbox only

Strong candidate for agent workflows

Use this skill in these scenarios

Web scraping

Coding agents

Sports analytics

Add it to a complete workflow

Web data pipeline

Coding review agent

Content growth agent

Compare before you install

Crawl4AI

Scrapling

Scrapy

EasySpider

Overview

Platform Compatibility

Technical Details

Companion skill

Install review

Agent Proven evidence

Add to agent workflow

Share kit

Community indexed

Claim this skill listing

README badge

Author

Tags

Platform Fit

Health Signals

Community Signal

Trust & Safety

Related Skills