Headless Chrome Crawler alternatives for AI agents.

Headless Chrome .NET API

Proxy server to bypass Cloudflare protection

💯 Teach puppeteer new tricks through plugins.

a reliable high-level web crawling & scraping framework for Node.js.

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Headless Chromium-based web performance metrics collector and monitoring tool

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

Puppeteer, Headless Chrome；爬取《es6标准入门》、自动推文到掘金、站点性能分析；高级爬虫、自动化UI测试、性能分析；

Web Extension for saving a faithful copy of a complete web page in a single HTML file

Run tests using Jest & Puppeteer 🎪✨

Puppeteer Pool, run a cluster of instances in parallel

Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

Flexible Node.js AI-assisted crawler library

Starter Kit for running Headless-Chrome by Puppeteer on AWS Lambda.

Run Google Lighthouse on your entire site.

Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps to avoid Cloudflare and DataDome CAPTCHA pages. Easy to patch/unpatch, can be enabled/disabled on demand.