Whisper
Robust Speech Recognition via Large-Scale Weak Supervision
Port of OpenAI's Whisper model in C/C++
whisper.cpp is an open-source audio project by ggml-org (ggml-org/whisper.cpp on GitHub). It has 54,108 GitHub stars and 6,205 forks, is released under the MIT license, and was last updated on GitHub on 2 October 2026.
Speech-to-text, text-to-speech, voice cloning, or music/SFX generation — each project here has a lane.
Python packages, Docker images, and C++ builds cover servers, desktops, and edge devices.
Download the weights or pick a voice; many tools bundle a strong default so you can start immediately.
Transcribe files, synthesize scripts, or generate music — then export standard audio formats.
Open speech recognition now rivals paid APIs on accuracy across languages.
Modern TTS is strikingly human — good enough for narration and voiceovers.
Clone a voice from a short sample for consistent characters and branding.
Compose backing tracks and sound effects from text descriptions.
Entire pipelines work without internet — ideal for private or field use.
Drop-in endpoints that mimic commercial APIs, so existing apps switch easily.
Clone the repository or download the latest release for your OS.
git clone https://github.com/ggml-org/whisper.cpp.gitEvery project documents its own setup — the README's install section is the source of truth.
Start the app or server as documented and open the interface it provides.
Excellent — the leading open models match commercial services on clean audio, in many languages.
The tech clones from short samples; only ever clone voices you own or have explicit permission to use.
It is an open-source project at ggml-org/whisper.cpp with 6,205 forks. Check the repo's contributors and recent commits to see how active maintenance is.
Transcription and TTS run on CPU acceptably; GPUs speed up batch jobs and music generation a lot.
Coverage varies — transcription is broadest, TTS quality is best in major languages.
Usually yes, but check both the code license and the model license.
Robust Speech Recognition via Large-Scale Weak Supervision
Faster Whisper transcription with CTranslate2
Fast and local neural text-to-speech engine
WhisperLive: a nearly-live OpenAI Whisper transcription server for files, mics, and streams
Fast local speech-to-text across 16+ model families, powered by ggml.
Turn the beloved Kokoro voice model into an OpenAI-compatible speech API with one Docker command.
The most-starred other Audio projects in the LibreAI catalogue — the realistic shortlist if whisper.cpp is not the right fit.
利用 AI 大模型和自动化工作流,根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.
Robust Speech Recognition via Large-Scale Weak Supervision
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)
Clone a voice from 5 seconds of audio and generate arbitrary speech in real time
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creatio…
Free and open — grab the source, star the repo, and start creating.