AI Agent Skills

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask,…

Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient wa…

:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis

:zap: A distributed crawler for weibo, building with celery and requests.

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

Distributed crawler powered by Headless Chrome

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

ScopeSentry-Cyberspace mapping, subdomain enumeration, port scanning, sensitive information discovery, vulnerability scanning, distributed nodes

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks…