Bring portraits to life!

"ViMax: Agentic Video Generation (Director, Screenwriter, Producer, and Video Generator All-in-One)"

SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer

🚀 Truly open-source AI avatar(digital human) toolkit for offline video generation and digital human cloning.

🚀 AI 全自动短视频引擎 | AI Fully Automated Short Video Engine

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

Stable Diffusion web UI

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

Translate the video from one language to another and embed dubbing & subtitles.

An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System

Speech recognition module for Python, supporting several engines and APIs, online and offline.

Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.

Port of OpenAI's Whisper model in C/C++

Video, Image and GIF upscale/enlarge(Super-Resolution) and Video frame interpolation. Achieved with Waifu2x, Real-ESRGAN, Real-CUGAN, RTX Video Super Resolution VSR, SRMD, RealSR, Anime4K, RIFE, IFRNet, CAIN, DAIN, and ACNet.