Multilingual speech understanding: ASR + emotion recognition + audio event detection. 50+ languages, 15x faster than Whisper, non-autoregressive.

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

A PyTorch-based Speech Toolkit

The open-source ElevenLabs alternative for local voice cloning, design, create, dubbing and dictation Desktop App

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

Speech recognition module for Python, supporting several engines and APIs, online and offline.

End-to-End Speech Processing Toolkit

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

Port of OpenAI's Whisper model in C/C++

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

Translate the video from one language to another and embed dubbing & subtitles.