Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

💫 Industrial-strength Natural Language Processing (NLP) in Python

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

Open standard for machine learning interoperability

🐍 Geometric Computer Vision Library for Spatial AI

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

12 Weeks, 24 Lessons, AI for All!

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Deep Learning for humans

Ultralytics YOLOv5 in PyTorch > ONNX > CoreML > TFLite

Deepfakes Software For All

We write your reusable computer vision tools. 💜

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠