Аудио
Coqui TTS
Deep learning toolkit for text-to-speech, battle-tested in research and production
★ 46,1 тыс. звёздMPL-2.0
Смотреть руководство →Amphion — проект с открытым исходным кодом из категории «Аудио» от open-mmlab (open-mmlab/Amphion на GitHub). У него 10 305 звёзд на GitHub и 851 форк, он распространяется по лицензии MIT и последний раз обновлялся на GitHub 25 марта 2026.
Open research toolkit for text-to-speech, voice conversion, singing voice and text-to-audio generation.
Clone the repo, create the pinned conda environment and run the dependency script - or pull the Docker image instead.
Choose your generation task (TTS, voice conversion, singing, text-to-audio) and a model line, such as MaskGCT or Vevo for zero-shot speech, from the per-task READMEs.
Use Amphion's unified preprocessing for datasets like LibriTTS, LJSpeech or VCTK, or download a pretrained checkpoint from Hugging Face.
Run the model's training or inference recipe and score results with the built-in objective metrics (intelligibility, speaker similarity, FAD and more).
FastSpeech2, VITS, VALL-E, NaturalSpeech2, Jets, the non-autoregressive MaskGCT and the controllable zero-shot Vevo family, with per-model code and checkpoints.
Zero-shot voice conversion (Vevo, FACodec, Noro), accent conversion, and singing voice conversion/synthesis including the unified Vevo2 framework for speech and singing.
A latent-diffusion text-to-audio model, plus neural audio codecs such as DualCodec and FACodec for token-based generation.
GAN vocoders (MelGAN, HiFi-GAN, BigVGAN), flow (WaveGlow), diffusion (DiffWave) and autoregressive (WaveNet, WaveRNN) vocoders under one roof.
F0 and energy modeling metrics, intelligibility (CER/WER), spectrogram distortion (FAD, MCD, PESQ, STOI) and speaker-similarity scoring.
The 100k+ hour Emilia in-the-wild speech dataset with its Emilia-Pipe preprocessing pipeline, and interactive visualizations such as SingVisio that explain classic model internals.
Clone Amphion and enter the project directory.
git clone https://github.com/open-mmlab/Amphion.git
cd AmphionCreate and activate the Python environment the README specifies (a Docker image is the documented alternative).
conda create --name amphion python=3.9.15
conda activate amphionRun the project's environment script to install the required Python packages.
sh env.shAmphion is maintained by the open-mmlab community and contributing research groups, with releases announced through the repository and its Discord.
The toolkit is MIT-licensed. Individual datasets and some pretrained assets keep their own licenses - for example the Emilia dataset is CC BY-NC 4.0 - so check the asset you use.
No. Amphion is a local research toolkit; models train and run on your own hardware, and you will want a GPU for serious training.
Those focus mainly on speech synthesis pipelines; Amphion covers a wider research surface - TTS, voice and singing conversion, text-to-audio, codecs, vocoders, metrics and datasets - with an emphasis on reproducing papers.
Clone the repo, run the conda setup and env.sh, then follow the per-task README for a model like MaskGCT with its pretrained checkpoint.
Deep learning toolkit for text-to-speech, battle-tested in research and production
Fish Speech — Fish Audio's expressive open text-to-speech and voice cloning: SOTA-quality TTS you can self-host, under the Fish Audio Community License (check terms)
A speech-to-text server framework built on next-generation Kaldi.
Suno's text-prompted generative audio model: speech, music and sound effects from text prompts
A pure C++ ggml inference engine for audio models — TTS, STT, VAD, voice conversion and music.
Speech-to-text-to-speech for VRChat, VTubers, and streamers.
Другие проекты из категории «Аудио» с наибольшим числом звёзд в каталоге LibreAI — реалистичный список альтернатив, если Amphion вам не подходит.
利用 AI 大模型和自动化工作流，根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.
Robust Speech Recognition via Large-Scale Weak Supervision
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)
Clone a voice from 5 seconds of audio and generate arbitrary speech in real time
Port of OpenAI's Whisper model in C/C++
Соседние проекты из категории «Аудио» в каталоге, ближайшие по числу звёзд к Amphion — продолжайте изучать полку по обе стороны от него.
Silero VAD: pre-trained enterprise-grade Voice Activity Detector
Mozilla's deep-learning text-to-speech library with Tacotron, Glow-TTS and neural vocoders.
Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding
A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.
Self-hosted backend that gives ESP32 'Xiaozhi' devices streaming voice chat, memory and tool control.
End-to-End Speech Processing Toolkit
Бесплатно и открыто — забирайте исходный код, ставьте звезду репозиторию и начинайте создавать.