Speechbrain alternatives for AI agents.

SincNet is a neural architecture for efficiently processing raw audio samples.

End-to-End Speech Processing Toolkit

Production First and Production Ready End-to-End Speech Recognition Toolkit

Lingvo

Fine-tune the Whisper speech recognition model to support training without timestamp data, training with timestamp data, and training without speech data. Accelerate inference and support Web deployment, Windows desktop deployment, and Android deployment

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

Tools for handling multimodal data in machine learning projects.

Pytorch实现的流式与非流式的自动语音识别框架，同时兼容在线和离线识别，目前支持Conformer、Squeezeformer、DeepSpeech2模型，支持多种数据增强方法。

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

Faster Whisper transcription with CTranslate2

StreamSpeech is an “All in One” seamless model for offline and simultaneous speech recognition, speech translation and speech synthesis.

Speech recognition module for Python, supporting several engines and APIs, online and offline.

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.