GOSINT alternatives for AI agents.

Elegant Scraper and Crawler Framework for Golang

Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.

👾 Fast and simple video download library and CLI tool written in Go

A next-generation crawling and spidering framework.

Declarative web scraping

Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

小说下载|小说爬取|起点|笔趣阁|导出Markdown|导出txt|转换epub|广告过滤|自动校对

Automatically crawls proxy nodes on the public internet, de-duplicates and tests for usability and then provides a list of nodes

Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

:paw_prints: Creeper - The Next Generation Crawler Framework (Go)

Open source SEO audit tool.

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

Gospider - Fast web spider written in Go

带你了解一下Golang的市场行情

Polite, slim and concurrent web crawler.