LibreAI / AI Music / DiffRhythm
// ai-music · ASLP-lab/DiffRhythm

DiffRhythm

DiffRhythm — blazingly fast, embarrassingly simple full-length song generation with latent diffusion: complete songs with vocals from lyrics and a style prompt, Apache-2.0

★ 2.4k stars⑂ 279 forksApache-2.0updated 2025-11
▦ visual — this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
// project facts

Project facts

DiffRhythm is an open-source ai music project by ASLP-lab (ASLP-lab/DiffRhythm on GitHub). It has 2,350 GitHub stars and 279 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 27 November 2025.

GitHub stars
2,350
Forks
279
License
Apache-2.0
Last updated on GitHub
27 November 2025
Category
AI Music
Listing
Full install guide
// how it works

How it works

  1. Clone and install system dependency

    Clone the repo and install espeak-ng (apt/brew, or the .msi on Windows) — inference depends on it, per the README.

  2. Create the environment

    conda create -n diffrhythm python=3.10 (or a plain venv), activate it, then pip install -r requirements.txt. On Windows, set the eSpeak NG path in your environment variables first, per the README.

  3. Generate a song

    Run the inference script with your lyrics and either a reference WAV file or a text style prompt; or use the Docker compose route in the docker folder.

// features

Why people love it

Full-length songs, end to end

Generates complete songs with vocals in one latent-diffusion model instead of stitched sections.

Lyrics + style in

Condition on lyrics and a style described in text, or steer the sound with a reference audio file.

Simple by design

One repo, one requirements file, one inference script — the project pitch is that song generation does not need a pipeline empire.

A growing family

DiffRhythm+ and DiffRhythm 2 extend the line, with papers, demos and a Hugging Face Space to try in the browser.

Advertisement
// run it

Run it yourself

  1. Clone

    Get the code first.

    git clone https://github.com/ASLP-lab/DiffRhythm.git
    cd DiffRhythm
  2. Environment

    The README inference setup: espeak-ng, then conda + requirements.

    sudo apt-get install espeak-ng
    conda create -n diffrhythm python=3.10
    conda activate diffrhythm
    pip install -r requirements.txt
  3. Docker alternative

    The README docker route: edit the compose bindings in the docker folder, compose up, then exec into the container.

    docker compose up -d
    docker exec -it DiffRhythm bash
// use cases

What you can build

Advertisement
// faq

Questions, answered

Who makes DiffRhythm?

ASLP-lab (the Audio, Speech and Language Processing lab team behind the repo) with named authors on the papers — ASLP-lab/DiffRhythm on GitHub.

Is DiffRhythm free?

Yes — Apache-2.0 licensed. Check rights for any reference audio or lyrics you feed it before releasing output commercially.

What does it need to run?

A Python 3.10 environment, the requirements file, espeak-ng installed, and a GPU for practical generation speeds — or use the Hugging Face Space demo to try it with none of that.

How does it compare to a well-known alternative?

Against ACE-Step (also added this week), DiffRhythm is the simpler, single-purpose song generator — lyrics and style in, full song out — while ACE-Step is the broader foundation model with editing, cloning and repaint controls. Against Suno, DiffRhythm is open, self-hosted and Apache-2.0.

How do I get started?

Clone, install espeak-ng, conda create -n diffrhythm python=3.10, pip install -r requirements.txt, then run inference with your lyrics and a style prompt.

// keep exploring

Similar tools

AI Music

ACE-Step

ACE-Step — the open foundation model for music generation: full songs with vocals and lyrics in 19 languages, up to 4 minutes in about 20 seconds, Apache-2.0

★ 5.0k starsApache-2.0
View guide →
AI Music

YuE2-Studio

Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, …

★ 424 starsMIT
View guide →
AI Music

ACE-Step-Studio

Portable AI music generator — full songs with vocals, covers, music videos. One-click install, 100% offline, NVIDIA GPU.

★ 374 starsMIT
View guide →
AI Music

ComfyUI_FL-HeartMuLa

ComfyUI nodes for multilingual AI songs with lyrics via HeartMuLa.

★ 133 starsCustom
View guide →
AI Music

suno-cli

Terminal client for Suno v5.5 — tags, vocal control, and full generation flags.

★ 56 starsMIT
View guide →
AI Music

melodyc

Open-source AI music SaaS: full tracks with cover art from a text prompt.

★ 49 starsMIT
View guide →
// alternatives

Alternatives in AI Music

The most-starred other AI Music projects in the LibreAI catalogue — the realistic shortlist if DiffRhythm is not the right fit.

Get DiffRhythm

Free and open — grab the source, star the repo, and start creating.