Real-Time-Voice-Cloning
Clone a voice from 5 seconds of audio and generate arbitrary speech in real time
VieNeu-TTS ist ein Open-Source-Projekt aus der Kategorie Audio von pnnbao97 (pnnbao97/VieNeu-TTS auf GitHub). Es hat 2.787 Sterne auf GitHub und 862 Forks, wird unter der Lizenz Apache-2.0 veröffentlicht und wurde zuletzt am 30. September 2026 auf GitHub aktualisiert.
Vietnamese TTS with instant voice cloning — on-device, real-time CPU inference, 48 kHz audio
Choose a built-in voice, plan to clone a voice from a short clip, or run the streaming API server for an app.
Install the vieneu SDK from PyPI for code use, or clone the repo and sync dependencies with uv for the Web UI.
Pick the CPU path (uv sync / pip install vieneu) or the GPU path (uv sync --extra cuda); Windows users can also use the standalone installer from vieneu.io.
Call Vieneu().infer(...) with Vietnamese text and a voice name, or start the Web UI and generate from the browser.
The current open-source architecture (with its own audio tokenizer and phonemizer) outputs 48 kHz audio, up from 24 kHz in v2.
Built-in voices cover Northern, Central and Southern accents, with 10 editors' picks recommended as starting points — no reference clip needed.
Clone a voice from a 3–8 second clip, with automatic reference denoising.
infer_stream streams frame by frame on CPU and GPU, and an OpenAI-compatible POST /v1/audio/speech API works with the OpenAI SDK, Pipecat and LiveKit.
Batched generation (up to batch size 32) including a multi-speaker conversation mode that batches a whole script.
Train your own voice or reading style on one consumer GPU.
Clone VieNeu-TTS for the Web UI / full repo experience; SDK-only users can skip to pip install vieneu.
git clone https://github.com/pnnbao97/VieNeu-TTS.git
cd VieNeu-TTSUse uv as the README recommends — CPU/minimal, or with the cuda extra for GPU.
uv sync
# GPU: uv sync --extra cudaLaunch the Gradio UI, or pip install vieneu and call Vieneu().infer(text, voice=...) from Python.
uv run vieneu-web # http://127.0.0.1:7860
# SDK: pip install vieneuReaders working through the Audio shelf also stop at assemblyai-node-sdk, Official JS SDK for AssemblyAI transcription and audio intelligence. Also on this shelf: sussurro — Entirely local, open source voice-to-text utility.
It is created and maintained by pnnbao97 (Phạm Nguyễn Ngọc Bảo); the commercial v4 and app live at vieneu.io.
The code in this repo (v3 Turbo) is Apache-2.0 licensed and free. The README states v4 is proprietary and only offered through the VieNeu API/site.
No — the open-source version runs on-device (CPU via ONNX Runtime, or your own GPU). No cloud key is required.
gTTS calls Google Translate's hosted speech endpoint with fixed voices. VieNeu is a local Vietnamese-first model with preset regional voices, cloning, streaming and much higher audio quality (48 kHz).
pip install vieneu, then vieneu = Vieneu(); audio = vieneu.infer(text, voice=...) — or clone and run uv run vieneu-web.
Clone a voice from 5 seconds of audio and generate arbitrary speech in real time
MOSS-TTS family: open text-to-speech models for voice cloning, dialogue, voice design, and real-time agents
Open-source real-time spoken dialogue with personalized voice cloning.
MOSS-TTS-Nano: a 0.1B open multilingual speech model that clones voices and streams in real time on CPU
A pure C++ ggml inference engine for audio models — TTS, STT, VAD, voice conversion and music.
Fish Speech — Fish Audio's expressive open text-to-speech and voice cloning: SOTA-quality TTS you can self-host, under the Fish Audio Community License (check terms)
Die anderen Projekte der Kategorie Audio mit den meisten Sternen im LibreAI-Katalog — die realistische Auswahl, falls VieNeu-TTS nicht das Richtige ist.
利用 AI 大模型和自动化工作流,根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.
Robust Speech Recognition via Large-Scale Weak Supervision
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)
Clone a voice from 5 seconds of audio and generate arbitrary speech in real time
Port of OpenAI's Whisper model in C/C++
Verwandte Projekte der Kategorie Audio im Katalog, die VieNeu-TTS bei den Sternen am nächsten stehen — zum Weiterstöbern auf beiden Seiten.
MARS5 speech model from CAMB.AI — clone a voice from 5 seconds of audio with striking prosody
gTTS — Python library and CLI that turns text into spoken mp3 via Google Translate's speech API
Unofficial PyTorch implementation of VALL-E, the neural codec language model for zero-shot TTS
MaryTTS — open-source, multilingual text-to-speech platform written in pure Java
GPA — one tiny model that does ASR, TTS and voice conversion (General Purpose Audio).
Offline text-to-speech for Python — uses your operating system's own voices, no internet needed
Kostenlos und offen — hol dir den Quellcode, gib dem Repository einen Stern und leg los.