AI Agent Skills

The web scraping open project repository aims to share knowledge and experiences about web scraping with Python

Scrapy, a fast high-level web crawling & scraping framework for Python.

A static analyzer for Java, C, C++, and Objective-C

Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

Getting started with Puppeteer and Chrome Headless for Web Scraping

Simple web scraping for R

The complete web scraping toolkit for PHP.

AI Scraper is a powerful scraping tool and scrape agent built to automate data extraction with unmatched precision. Ideal for scalable AI scraping tasks across diverse w…

AI assisted web scraping and data extraction

An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of th…

Facebook AI Research's Automatic Speech Recognition Toolkit

Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.

DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

Markdown parser, done right. Commonmark support, extensions, syntax plugins, high speed - all in one. Gulp and metalsmith plugins available. Used by Facebook, Docusaurus…

gitGraber: monitor GitHub to search and find sensitive data in real time for different online services such as: Google, Amazon, Paypal, Github, Mailgun, Facebook, Twitte…

Open Source Intelligence Interface for Deep Web Scraping