What is MediaCrawler?
MediaCrawler is a powerful multi-platform social media crawler designed for AI agent workflows. Supporting Xiaohongshu (RED), Douyin (TikTok CN), Kuaishou, Bilibili, Weibo, Zhihu, and Baidu Tieba, it provides a unified interface to collect posts, comments, user data, and engagement metrics across China's most popular platforms. With 43,000+ stars, it's the most comprehensive Chinese social media data tool available.
Key Features
- 8 platforms supported — Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Zhihu, Tieba, and more
- Comment extraction — deep comment threads with user info and engagement data
- Search & keyword crawling — find content by hashtag, keyword, or user
- Cookie-based auth — use your own account cookies for authenticated access
- Async architecture — fast parallel collection with built-in rate limiting
Use Cases
Brand Monitoring Agent
Build an agent that tracks brand mentions across all major Chinese social platforms, aggregates sentiment, and generates daily reports.
Content Research Pipeline
Collect viral content by keyword, analyze what makes posts perform well, and inform your own content strategy with real data.
Competitive Intelligence
Track competitor accounts, monitor their posting frequency and engagement, and surface insights for your marketing team.
Quick Start
npx skills add NanmiCoder/MediaCrawler
from media_crawler import XiaoHongShuCrawler
crawler = XiaoHongShuCrawler()
results = await crawler.search(keyword="AI工具", limit=50)
for post in results:
print(post.title, post.likes, post.comments)
Why We Love It
For anyone building AI agents that need to understand Chinese social media, MediaCrawler is indispensable. There is simply no comparable alternative that covers this many platforms with this level of depth. The 43K star community has contributed extensive documentation and real-world usage patterns, making it surprisingly approachable despite the complexity of the platforms it covers.