SALMONN alternatives for AI agents.

A PyTorch-based Speech Toolkit

Speech recognition module for Python, supporting several engines and APIs, online and offline.

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

SincNet is a neural architecture for efficiently processing raw audio samples.

End-to-end speech recognition large model: 31 languages, dialects, accents, lyrics, hotwords, timestamps, speaker diarization. Trained on tens of millions of hours.

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

Tools for handling multimodal data in machine learning projects.

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

Port of OpenAI's Whisper model in C/C++

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

Faster Whisper transcription with CTranslate2

Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.

StreamSpeech is an “All in One” seamless model for offline and simultaneous speech recognition, speech translation and speech synthesis.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference