Skill-Verzeichnis

Wiederverwendbare Skills für AI Agents entdecken.

Durchsuche reale GitHub-Skills nach Aufgabe und prüfe Stars, Trust, Audit, Kategorie und Installationspfad vor der Verwendung.

Jede Empfehlung bleibt mit ihrem Repository, Audit und Installationspfad nachvollziehbar.

Suchergebnisse: crawling

Englisches Verzeichnis

Open-source LLM-friendly web crawler and scraper

73K
Stars
82/100
Trust
Kategorie: web-automationAudit

Scrapy, a fast high-level web crawling & scraping framework for Python.

63K
Stars
82/100
Trust
Kategorie: web-automationAudit

A next-generation crawling and spidering framework.

17K
Stars
77/100
Trust
Kategorie: web-automationAudit

🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥

16K
Stars
85/100
Trust
Kategorie: web-automationAudit

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

6.4K
Stars
85/100
Trust
Kategorie: web-automationAudit

Web crawling framework based on asyncio.

2.0K
Stars
77/100
Trust
Kategorie: web-automationAudit

DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

4.1K
Stars
83/100
Trust
Kategorie: web-automationAudit

TuShare is a utility for crawling historical data of China stocks

15K
Stars
72/100
Trust
Kategorie: financeAudit

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.

2.9K
Stars
74/100
Trust
Kategorie: web-automationAudit

Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!

444
Stars
70/100
Trust
Kategorie: devopsAudit

All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers

3.7K
Stars
70/100
Trust
Kategorie: web-automationAudit

Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

2.8K
Stars
73/100
Trust
Kategorie: web-automationAudit