WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

Port of OpenAI's Whisper model in C/C++

Speech recognition module for Python, supporting several engines and APIs, online and offline.

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isolation, and multilingual translation.

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

A PyTorch-based Speech Toolkit

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

Multilingual speech understanding: ASR + emotion recognition + audio event detection. 50+ languages, 15x faster than Whisper, non-autoregressive.

The open-source ElevenLabs alternative for local voice cloning, design, create, dubbing and dictation Desktop App

Translate the video from one language to another and embed dubbing & subtitles.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

End-to-End Speech Processing Toolkit

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages