Photon
s0md3v
Incredibly fast crawler designed for OSINT.
12.9KGitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Find a skill for your next task. Preview examples where available.
Results · “news-crawler”
17–29 / 29
Results: 29
Gecco
xtuhcy
Easy to use lightweight web crawler（易用的轻量化网络爬虫）
2.5KGitHub
Gocrawl
PuerkitoBio
Polite, slim and concurrent web crawler.
2.1KGitHub
Weibospider
SpiderClub
:zap: A distributed crawler for weibo, building with celery and requests.
4.8KGitHub
Grab Site
ArchiveTeam
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
1.6KGitHub
Vlrggapi
axsddlr
An Unofficial REST API for vlr.gg, a site for Valorant Pro Esports match results and news.
213GitHub
Colly
gocolly
Elegant Scraper and Crawler Framework for Golang
25.3KGitHub
Feapder
Boris-code
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量…
3.7KGitHub
QueryList
jae-jae
:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
2.7KGitHub
Go Spider
hu17889
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you ca…
1.8KGitHub
Tracker Radar Collector
duckduckgo
🕸 Modular, multithreaded, puppeteer-based crawler
164GitHub
Binance News Sentiment Bot
CyberPunkMetalHead
This is a fully functioning Binance trading bot that takes into account the news sentiment for the top 100 crypto feeds. If you like this project consider donating thoug…
1.6KGitHub
Geo Seo Claude
zubair-trabzada
GEO-first SEO skill for Claude Code. Comprehensive AI search optimization for any website — citability scoring, AI crawler analysis, brand authority, schema markup, plat…
8.1KGitHub