Audio
Coqui TTS
Deep learning toolkit for text-to-speech, battle-tested in research and production
★ 46,1 Tsd. SterneMPL-2.0
Anleitung ansehen →Amphion ist ein Open-Source-Projekt aus der Kategorie Audio von open-mmlab (open-mmlab/Amphion auf GitHub). Es hat 10.305 Sterne auf GitHub und 851 Forks, wird unter der Lizenz MIT veröffentlicht und wurde zuletzt am 25. März 2026 auf GitHub aktualisiert.
Open research toolkit for text-to-speech, voice conversion, singing voice and text-to-audio generation.
Clone the repo, create the pinned conda environment and run the dependency script - or pull the Docker image instead.
Choose your generation task (TTS, voice conversion, singing, text-to-audio) and a model line, such as MaskGCT or Vevo for zero-shot speech, from the per-task READMEs.
Use Amphion's unified preprocessing for datasets like LibriTTS, LJSpeech or VCTK, or download a pretrained checkpoint from Hugging Face.
Run the model's training or inference recipe and score results with the built-in objective metrics (intelligibility, speaker similarity, FAD and more).
FastSpeech2, VITS, VALL-E, NaturalSpeech2, Jets, the non-autoregressive MaskGCT and the controllable zero-shot Vevo family, with per-model code and checkpoints.
Zero-shot voice conversion (Vevo, FACodec, Noro), accent conversion, and singing voice conversion/synthesis including the unified Vevo2 framework for speech and singing.
A latent-diffusion text-to-audio model, plus neural audio codecs such as DualCodec and FACodec for token-based generation.
GAN vocoders (MelGAN, HiFi-GAN, BigVGAN), flow (WaveGlow), diffusion (DiffWave) and autoregressive (WaveNet, WaveRNN) vocoders under one roof.
F0 and energy modeling metrics, intelligibility (CER/WER), spectrogram distortion (FAD, MCD, PESQ, STOI) and speaker-similarity scoring.
The 100k+ hour Emilia in-the-wild speech dataset with its Emilia-Pipe preprocessing pipeline, and interactive visualizations such as SingVisio that explain classic model internals.
Clone Amphion and enter the project directory.
git clone https://github.com/open-mmlab/Amphion.git
cd AmphionCreate and activate the Python environment the README specifies (a Docker image is the documented alternative).
conda create --name amphion python=3.9.15
conda activate amphionRun the project's environment script to install the required Python packages.
sh env.shAmphion is maintained by the open-mmlab community and contributing research groups, with releases announced through the repository and its Discord.
The toolkit is MIT-licensed. Individual datasets and some pretrained assets keep their own licenses - for example the Emilia dataset is CC BY-NC 4.0 - so check the asset you use.
No. Amphion is a local research toolkit; models train and run on your own hardware, and you will want a GPU for serious training.
Those focus mainly on speech synthesis pipelines; Amphion covers a wider research surface - TTS, voice and singing conversion, text-to-audio, codecs, vocoders, metrics and datasets - with an emphasis on reproducing papers.
Clone the repo, run the conda setup and env.sh, then follow the per-task README for a model like MaskGCT with its pretrained checkpoint.
Deep learning toolkit for text-to-speech, battle-tested in research and production
Fish Speech — Fish Audio's expressive open text-to-speech and voice cloning: SOTA-quality TTS you can self-host, under the Fish Audio Community License (check terms)
A speech-to-text server framework built on next-generation Kaldi.
Suno's text-prompted generative audio model: speech, music and sound effects from text prompts
A pure C++ ggml inference engine for audio models — TTS, STT, VAD, voice conversion and music.
Speech-to-text-to-speech for VRChat, VTubers, and streamers.
Die anderen Projekte der Kategorie Audio mit den meisten Sternen im LibreAI-Katalog — die realistische Auswahl, falls Amphion nicht das Richtige ist.
利用 AI 大模型和自动化工作流，根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.
Robust Speech Recognition via Large-Scale Weak Supervision
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)
Clone a voice from 5 seconds of audio and generate arbitrary speech in real time
Port of OpenAI's Whisper model in C/C++
Verwandte Projekte der Kategorie Audio im Katalog, die Amphion bei den Sternen am nächsten stehen — zum Weiterstöbern auf beiden Seiten.
Silero VAD: pre-trained enterprise-grade Voice Activity Detector
Mozilla's deep-learning text-to-speech library with Tacotron, Glow-TTS and neural vocoders.
Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding
A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.
Self-hosted backend that gives ESP32 'Xiaozhi' devices streaming voice chat, memory and tool control.
End-to-End Speech Processing Toolkit
Kostenlos und offen — hol dir den Quellcode, gib dem Repository einen Stern und leg los.