AI Agent Skills

🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量…

:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you ca…

The unix-way web crawler

ACHE is a web crawler for domain-specific search.

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM…

Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realis…

A Facebook crawler

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

Crawler (Bot) searching for credential leaks on paste sites.

:paw_prints: Creeper - The Next Generation Crawler Framework (Go)

Incredibly fast crawler designed for OSINT.

a new crawler based on python with more function including Network fingerprint search

Flexible Node.js AI-assisted crawler library

:zap: A distributed crawler for weibo, building with celery and requests.

Turn websites into clean markdown or structured data for retrieval and agents.