A framework for building realtime voice AI agents 🤖🎙️📹
Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.
A framework for building realtime voice AI agents 🤖🎙️📹
Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Buzz transcribes and translates audio offline on your personal computer. Powered by OpenAI's Whisper.
SOTA Open Source TTS
WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
Faster Whisper transcription with CTranslate2
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
The open-source AI voice studio. Clone, dictate, create.
Robust Speech Recognition via Large-Scale Weak Supervision
Easily train a good VC model with voice data <= 10 mins!
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.
https://hf.co/hexgrad/Kokoro-82M
An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
A generative speech model for daily dialogue.
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)