Trafilatura
adbar
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Web ScrapingSkill source unconfirmed
6.4KGitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Results · “anti-crawling”
17–26 / 26
More filters · 1
Candidates in this shortlist, not the full registry. GitHub stars belong to repositories, not individual skills.
Results: 26
Browser Fingerprinting
niespodd
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping…
5KGitHub
DotnetSpider
dotnetcore
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Web ScrapingSkill source unconfirmed
4.1KGitHub
Skills
browser-act
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent mult…
2.4KGitHub
2KGitHub
Oxylabs AI Studio Py
oxylabs
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM…
2.9KGitHub
RED HAWK
Tuhinshubhra
All in one tool for Information Gathering, Vulnerability Scanning and Crawling. A must have tool for all penetration testers
Web ScrapingSkill source unconfirmed
3.7KGitHub
Geziyor
geziyor
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
Web ScrapingSkill source unconfirmed
2.8KGitHub
Browser Search
Johell1NS
A skill for AI agents: search the web with SearXNG, browse with Camofox, bypass protections with CloakBrowser. Anti-hallucination by design. Self-hosted, free, unlimited.
360GitHub
Kuri
justrach
Browser automation, web crawling, and iOS + Android device control for AI agents. Zig-native, token-efficient CDP snapshots, HAR recording, native adb wire-protocol clie…
331GitHub