Decision filters
50 skills matching "scrape"
Best blend of quality, stars, freshness, and agent usage
Web crawling built for AI
$ npx skills add unclecode/crawl4ai🔥 Search, scrape, and clean the web for AI agents.
$ npx skills add firecrawl/firecrawlExtract web data with LLM-guided scraping graphs
$ npx skills add ScrapeGraphAI/Scrapegraph-aiElegant Scraper and Crawler Framework for Golang
$ npx skills add gocolly/collynewspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
$ npx skills add codelucas/newspaper👾 Fast and simple video download library and CLI tool written in Go
$ npx skills add iawia002/luxPydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.
$ npx skills add autoscrape-labs/pydollscrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
$ npx skills add gosom/google-maps-scraperFree Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.
$ npx skills add oxylabs/amazon-scraper:spider: The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
$ npx skills add jae-jae/QueryListTurn any webpage into structured data using LLMs
$ npx skills add mishushakov/llm-scraper小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 知乎问答文章 | 评论爬虫。支持多平台社交媒体内容抓取，提供完整的数据采集解决方案。
$ npx skills add NanmiCoder/MediaCrawlerTo extract main article from given URL with Node.js
$ npx skills add extractus/article-extractorNewPipe's core library for extracting data from streaming sites
$ npx skills add TeamNewPipe/NewPipeExtractorTransform Web Content into LLM-Ready Data
$ npx skills add watercrawl/WaterCrawlPython binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
$ npx skills add rushter/selectolaxScrape tweets, profiles, followers and following from Twitter/X, no API key needed. Python library with smart multi-account pooling, proxy support and async.
$ npx skills add Altimis/ScweetGive your AI the power to browse, scrape, and extract structured data from complex websites — with faster execution, lower cost, and more reliable results.
$ npx skills add browser-act/skillsNode.js scraper to get data from Google Play
$ npx skills add facundoolano/google-play-scraperTrap AI web scrapers in an endless poison pit.
$ npx skills add austin-weeks/miasma🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音、快手、TikTok、Bilibili数据爬取工具，支持API调用，在线批量解析及下载。
$ npx skills add Evil0ctal/Douyin_TikTok_Download_APIWebsite Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
$ npx skills add goclone-dev/gocloneLearn how to build your own Google Jobs scraper that simultaneously scrapes Google Jobs for multiple search queries and geo-locations with Python and Oxylabs’ Google Jobs Scraper API. https://oxylabs.io/blog/how-to-scrape-google-jobs
$ npx skills add oxylabs/how-to-scrape-google-jobsIn this tutorial, we showcase how to scrape public Google data with Python and Oxylabs API.
$ npx skills add oxylabs/scrape-google-pythonAI Map is an AI-powered website mapping tool by Oxylabs AI Studio that uses natural language prompts to intelligently discover and extract relevant URLs from any website.
$ npx skills add oxylabs/ai-map-pyStructured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.
$ npx skills add oxylabs/oxylabs-ai-studio-pyLearn step-by-step how to scrape Google Trends data and make a result comparison using Python and Oxylabs SERP API. Extract keywords, their popularity, breakdown by region, related queries, and more.
$ npx skills add oxylabs/how-to-scrape-google-trendsA Smart, Automatic, Fast and Lightweight Web Scraper for Python
$ npx skills add alirezamika/autoscraperA guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.
$ npx skills add oxylabs/how-to-scrape-google-scholarWrite web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI to figure out where the data lives, then caches the selectors and scrapes with pure Ruby. Get the intelligence of an LLM without the per-request latency or token costs.
$ npx skills add vifreefly/kimuraframeworkMovie metadata scraper
$ npx skills add sqzw-x/mdcxThe process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.
$ npx skills add oxylabs/how-to-scrape-amazon-product-dataScalable Python web scraping scripts for +40 popular domains
$ npx skills add scrapfly/scrapfly-scrapersA collection of awesome web crawler,spider in different languages
$ npx skills add BruceDone/awesome-crawlerA code for extracting best-selling items, search results, and currently available deals from Amazon using Python and Oxylabs E-Commerce Scraper API.
$ npx skills add oxylabs/how-to-scrape-amazon-pricesDistributed crawler powered by Headless Chrome
$ npx skills add yujiosaka/headless-chrome-crawlerNBA Stats API via Basketball Reference
$ npx skills add jaebradley/basketball_reference_web_scraperOpen source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.
$ npx skills add vakra-dev/readerUse Web Scraper API to extract data from Google Finance, including stock titles, pricing, and price changes in percentages.
$ npx skills add oxylabs/how-to-scrape-google-financeA Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
$ npx skills add NikolaiT/GoogleScraperGeziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
$ npx skills add geziyor/geziyorFetch user's data across social media
$ npx skills add shaikhsajid1111/social-media-profile-scrapers🤖 Scrape data from HTML websites automatically by just providing examples
$ npx skills add lorey/mlscraper:rocket: Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy
$ npx skills add tholian-network/stealthA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
$ npx skills add postmodern/spidr🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.
$ npx skills add ScrapeGraphAI/scrapecraftDetailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
$ npx skills add je-suis-tm/web-scrapingDataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes.
$ npx skills add DataHenHQ/tillA universal web-util for PHP.
$ npx skills add spekulatius/PHPScraper`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
$ npx skills add austinoboyle/scrape-linkedin-selenium