LibreAI / Audio / StyleTTS2
// audio · yl4579/StyleTTS2

StyleTTS2

StyleTTS2 es un proyecto de audio de código abierto de yl4579 (yl4579/StyleTTS2 en GitHub). Tiene 6.365 estrellas en GitHub y 709 bifurcaciones, se publica bajo la licencia MIT y se actualizó por última vez en GitHub el 10 de agosto de 2024.

Human-level text-to-speech through style diffusion and adversarial training with speech language models.

★ 6,4k estrellas⑂ 709 bifurcacionesMITactualizado ago 2024
▦ visual: el README de este proyecto no incluye ninguna captura incrustable,
así que aquí va un marcador. La guía de abajo está completa de todos modos.
// datos del proyecto

Datos del proyecto

Repositorio
yl4579/StyleTTS2
Estrellas en GitHub
6.365
Bifurcaciones
709
Licencia
MIT
Última actualización en GitHub
10 de agosto de 2024
Categoría
Audio
Tipo de ficha
Guía de instalación completa
// cómo funciona

Cómo funciona

  1. Clarify your voice goal

    Decide whether you will use a pretrained voice model or train/fine-tune on your own dataset and language.

  2. Clone and install

    Clone the repo, install PyTorch and the requirements, plus phonemizer and espeak-ng for text processing.

  3. Configure models

    Download a pretrained StyleTTS 2 model (LJSpeech or LibriTTS) or prepare your training config.

  4. Synthesize your first line

    Run inference with a reference audio clip to generate speech in that style, or start a training run.

// características

Por qué gusta tanto

Style diffusion synthesis

Models speech style with diffusion, producing natural, expressive prosody rather than flat monotone output.

Adversarial training with speech LMs

Uses large speech language models such as WavLM in adversarial training to push quality towards human level.

Zero-shot speaker adaptation

Adapts to a new speaker's style from a reference recording using the pretrained text aligner and pitch extractor.

Pretrained models published

Ready models trained on LJSpeech (24 kHz) and LibriTTS are downloadable from Hugging Face.

Full training pipeline

Includes first-stage, second-stage and fine-tuning training scripts with Accelerate support for your own datasets.

Multilingual path

Pretrained components cover English, Japanese and Chinese corpora, and a multilingual PL-BERT supports training other languages.

Advertisement
// ejecútalo

Ejecútalo tú mismo

  1. Clone the repository

    Clone StyleTTS 2 and enter the directory.

    git clone https://github.com/yl4579/StyleTTS2.git
    cd StyleTTS2
  2. Install dependencies

    Install the requirements, plus phonemizer and espeak-ng used for text processing.

    pip install -r requirements.txt
    pip install phonemizer
    sudo apt-get install espeak-ng
  3. Train or fine-tune

    For your own data, launch the documented two-stage training pipeline; for inference, download a pretrained model from Hugging Face and follow the README's inference notebook.

    accelerate launch train_first.py --config_path ./Configs/config.yml
    python train_second.py --config_path ./Configs/config.yml
// casos de uso

Qué puedes crear

Advertisement
// preguntas frecuentes

Preguntas frecuentes

Who maintains StyleTTS 2?

StyleTTS 2 is maintained by yl4579 and accompanies the StyleTTS 2 research paper.

Is it free?

The code is MIT licensed. Pretrained models have their own usage conditions described in the README, especially for voices not in the training set.

Does it need a paid API key?

No — inference and training run locally on your own GPU with downloaded models.

How does it compare to XTTS or F5-TTS?

All are open voice-cloning TTS systems; StyleTTS 2's distinction is its style-diffusion design plus adversarial training with speech language models, and its two-stage training pipeline.

How do I get started?

Clone the repo, install requirements and espeak-ng, download the LJSpeech or LibriTTS pretrained model from Hugging Face, and run the inference example.

// sigue explorando

Herramientas similares

Audio

kubeai

The easiest way to serve AI models, including speech-to-text, on Kubernetes.

★ 1,3k estrellasApache-2.0
Ver la guía →
Audio

silero-models

Silero Models: pre-trained text-to-speech models made embarrassingly simple

★ 6,1k estrellasCustom
Ver la guía →
Audio

vits

VITS — the original end-to-end text-to-speech model: a conditional VAE with adversarial learning, in PyTorch.

★ 7,9k estrellasMIT
Ver la guía →
Audio

index-tts

IndexTTS: industrial-level, controllable zero-shot text-to-speech with voice cloning

★ 24,4k estrellasNOASSERTION
Ver la guía →
Audio

Speech

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recogni…

★ 18,5k estrellasApache-2.0
Ver la guía →
Audio

Chatterbox

Chatterbox — Resemble AI's open-source TTS family: expressive text-to-speech and voice cloning, multilingual V3, low-latency Turbo and tiny Nano models, MIT

★ 27,1k estrellasMIT
Ver la guía →
// alternativas

Alternativas en Audio

Los demás proyectos de Audio con más estrellas del catálogo de LibreAI: la lista realista de alternativas si StyleTTS2 no es lo que buscas.

// más en audio

Más en Audio

Proyectos de Audio cercanos en el catálogo, los más próximos en estrellas a StyleTTS2: sigue explorando a ambos lados.

Consigue StyleTTS2

Gratis y abierto: consigue el código fuente, dale una estrella al repositorio y empieza a crear.