AI Agent Skill Repository

AI Agent Skills Directory

Browse reusable skills for Codex, Claude Code, Cursor, finance, research, web scraping, PPT, football analytics, data, marketing, design, and more.

Live registry search

Results for “scrape-websites

Exact name and slug matches are checked against the live registry before ranked alternatives.

Clear search

Decision filters

Choose by scenario, quality, and trust signals.

Showing 1-16 of 206 ranked candidates matching "scrape-websites"

Best blend of relevance, quality, freshness, and verified outcomes

1

How To Scrape Google Finance

VERIFIEDSTRONG · 73TRUST · 78SAFE · REVIEWEDFINANCE

Use Web Scraper API to extract data from Google Finance, including stock titles, pricing, and price changes in percentages.

$ npx skills add oxylabs/how-to-scrape-google-finance
1.1K stars52 quality78 trustReviewed with permission notes11mo since pushNeeds review

Scenario Finance and quant

CLI + Codex · 4 targets

pythonweb-automation
by oxylabsDetailsQuick view
2

Scrapegraph AI

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDRESEARCH

Python scraper based on AI

$ npx skills add ScrapeGraphAI/Scrapegraph-ai
1 agent calls100% success27.2K stars76 quality88 trustReviewed2mo since pushSafe to try

Scenario Document processing

CLI + Codex · 4 targets

pythonweb-automation
by ScrapeGraphAIDetailsQuick view
3

Mlscraper

VERIFIEDPROMISING · 61TRUST · 74SAFE · EXPERIMENTALCODING

🤖 Scrape data from HTML websites automatically by just providing examples

$ npx skills add lorey/mlscraper
1.4K stars49 quality74 trustExperimental2y since pushNeeds review

Scenario Coding agents

CLI + Codex · 4 targets

pythoncrawler
by loreyDetailsQuick view
4

How To Scrape Google Jobs

VERIFIEDEXCELLENT · 86TRUST · 81SAFE · REVIEWEDRESEARCH

Learn how to build your own Google Jobs scraper that simultaneously scrapes Google Jobs for multiple search queries and geo-locations with Python and Oxylabs’ Google Job…

$ npx skills add oxylabs/how-to-scrape-google-jobs
1.4K stars61 quality81 trustReviewed3mo since pushSafe to try

Scenario RAG and knowledge

CLI + Codex · 4 targets

pythonweb-automation
by oxylabsDetailsQuick view
5

Scrape Google Python

VERIFIEDEXCELLENT · 86TRUST · 81SAFE · REVIEWEDCODING

In this tutorial, we showcase how to scrape public Google data with Python and Oxylabs API.

$ npx skills add oxylabs/scrape-google-python
1.3K stars61 quality81 trustReviewed2mo since pushSafe to try

Scenario Coding agents

CLI + Codex · 4 targets

web-automation
by oxylabsDetailsQuick view
6

How To Scrape Google Trends

VERIFIEDSTRONG · 76TRUST · 79SAFE · REVIEWEDMARKETING

Learn step-by-step how to scrape Google Trends data and make a result comparison using Python and Oxylabs SERP API. Extract keywords, their popularity, breakdown by regi…

$ npx skills add oxylabs/how-to-scrape-google-trends
2.6K stars55 quality79 trustReviewed with permission notes8mo since pushNeeds review

Scenario Marketing and growth

CLI + Codex · 4 targets

pythonweb-automation
by oxylabsDetailsQuick view
7

How To Scrape Google Scholar

VERIFIEDSTRONG · 75TRUST · 78SAFE · REVIEWEDRESEARCH

A guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.

$ npx skills add oxylabs/how-to-scrape-google-scholar
1.7K stars53 quality78 trustReviewed with permission notes8mo since pushNeeds review

Scenario RAG and knowledge

CLI + Codex · 4 targets

pythonweb-automation
by oxylabsDetailsQuick view
8

Website Scraper Puppeteer

STRONG · 77TRUST · 78SAFE · REVIEWEDCODING

Plugin for website-scraper which returns html for dynamic websites using puppeteer

$ npx skills add website-scraper/website-scraper-puppeteer
374 stars52 quality78 trustReviewed with permission notesBrowser agents30d since pushSafe to try

Scenario Testing and QA

Browser agents + CLI · 4 targets

javascriptpuppeteer
by website-scraperDetailsQuick view
9

CF Clearance Scraper

STRONG · 72TRUST · 77SAFE · REVIEWEDCODING

A simple program for scraping Cloudflare clearance (cf_clearance) cookies from websites issuing Cloudflare challenges to visitors

$ npx skills add Xewdy444/CF-Clearance-Scraper
491 stars50 quality77 trustReviewed with permission notesBrowser agents3mo since pushNeeds review

Scenario Testing and QA

Browser agents + CLI · 4 targets

pythonplaywright
by Xewdy444DetailsQuick view
10

City Scrapers

PROMISING · 67TRUST · 74SAFE · REVIEWEDCODING

Scrape, standardize and share public meetings from local government websites

$ npx skills add City-Bureau/city-scrapers
379 stars45 quality74 trustReviewed with permission notesBrowser agents3mo since pushNeeds review

Scenario GitHub automation

Browser agents + CLI · 4 targets

htmlweb-automation
by City-BureauDetailsQuick view
11

Shot Scraper

VERIFIEDEXCELLENT · 93TRUST · 82SAFE · REVIEWEDCODING

A command-line utility for taking automated screenshots of websites

$ npx skills add simonw/shot-scraper
2.4K stars62 quality82 trustReviewed with permission notesBrowser agents2mo since pushSafe to try

Scenario Testing and QA

Browser agents + CLI · 4 targets

pythonplaywright
by simonwDetailsQuick view
12

Fb Friend List Scraper

NEEDS REVIEW · 45TRUST · 69SAFE · EXPERIMENTALCODING

OSINT tool to scrape names and usernames from large friend lists on Facebook, without being rate limited.

$ npx skills add n0kovo/fb_friend_list_scraper
324 stars36 quality69 trustExperimentalBrowser agents4y since pushNeeds review

Scenario Testing and QA

Browser agents + CLI · 4 targets

pythonweb-automation
by n0kovoDetailsQuick view
13

AnyCrawl

VERIFIEDEXCELLENT · 94TRUST · 86SAFE · REVIEWEDDATA

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading…

$ npx skills add any4ai/AnyCrawl
3.2K stars63 quality86 trustReviewed2mo since pushSafe to try

Scenario Web scraping

CLI + Codex · 4 targets

mdxrag
by any4aiDetailsQuick view
14

GoogleScraper

VERIFIEDPROMISING · 69TRUST · 78SAFE · REVIEWEDCODING

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

$ npx skills add NikolaiT/GoogleScraper
2.8K stars51 quality78 trustReviewed with permission notes5y since pushNeeds review

Scenario GitHub automation

CLI + Codex · 4 targets

htmlcrawler
by NikolaiTDetailsQuick view
15

Crawl4AI

VERIFIEDEXCELLENT · 100TRUST · 88SAFE · REVIEWEDRESEARCH

Web crawling built for AI

$ npx skills add unclecode/crawl4ai
4 agent calls100% success73.1K stars77 quality88 trustReviewedClaude Code + OpenAI Agents1mo since pushSafe to try

Scenario Research agents

Claude Code + OpenAI Agents · 4 targets

claudegpt-4langchaincrewaiopenclaw
by unclecodeDetailsQuick view
16

Rightmove Webscraper.Py

NEEDS REVIEW · 45TRUST · 68SAFE · EXPERIMENTALDATA

Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object

$ npx skills add toby-p/rightmove_webscraper.py
280 stars36 quality68 trustExperimental3y since pushNeeds review

Scenario Data analysis

CLI + Codex · 4 targets

pythoncsv
by toby-pDetailsQuick view

Page 1

Showing the strongest 16 results to keep the registry fast for humans and agents. Refine by use case, platform, stars, or search query for a narrower shortlist.

Try the agent resolve API