1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

Translate the video from one language to another and embed dubbing & subtitles.

An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

🚀 AI 全自动短视频引擎 | AI Fully Automated Short Video Engine

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

A PyTorch-based Speech Toolkit

Speech recognition module for Python, supporting several engines and APIs, online and offline.

End-to-End Speech Processing Toolkit

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isolation, and multilingual translation.

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages

Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.

Port of OpenAI's Whisper model in C/C++