WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

Speech recognition module for Python, supporting several engines and APIs, online and offline.

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isolation, and multilingual translation.

A PyTorch-based Speech Toolkit

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

Port of OpenAI's Whisper model in C/C++

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

Translate the video from one language to another and embed dubbing & subtitles.

🚀Clone a voice in 5 seconds to generate arbitrary speech in real-time

Multilingual speech understanding: ASR + emotion recognition + audio event detection. 50+ languages, 15x faster than Whisper, non-autoregressive.

End-to-End Speech Processing Toolkit

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages