AI Agent Skills

Python ProxyPool for web spider

Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.

Puppeteer Pool, run a cluster of instances in parallel

Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era

Various Algorithms for Short Text Mining

:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis

Siamese and triplet networks with online pair/triplet mining in PyTorch

A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB team.