AI Agent Skills

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mix…