AI Agent Skills

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o…

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The headless browser for AI agents and web scraping

🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

Declarative web scraping

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping…

Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.

Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored application materials.

Distributed crawler powered by Headless Chrome

ScopeSentry-Cyberspace mapping, subdomain enumeration, port scanning, sensitive information discovery, vulnerability scanning, distributed nodes

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks…