LibreAI / Audio / kubeai
// audio · kubeai-project/kubeai

kubeai

The easiest way to serve AI models, including speech-to-text, on Kubernetes.

💎 Hidden gem★ 1.3k stars⑂ 137 forksApache-2.0updated 2026-10
▦ visual — this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
// project facts

Project facts

kubeai is an open-source audio project by kubeai-project (kubeai-project/kubeai on GitHub). It has 1,272 GitHub stars and 137 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 1 October 2026.

GitHub stars
1,272
Forks
137
License
Apache-2.0
Last updated on GitHub
1 October 2026
Category
Audio
Listing
Hidden gem — a shorter page for a lesser-known project
Official site
Official site
// how it works

How it works

  1. Install the operator

    Deploy KubeAI into your Kubernetes cluster.

  2. Declare a model

    Describe the model you want to serve in a simple spec.

  3. Let it scale

    The autoscaler adjusts replicas to match demand.

  4. Call the endpoint

    Query it like any inference API, including STT.

// features

Why people love it

Kubernetes operator

Manages model lifecycles natively inside your cluster.

LLM + VLM + STT

Serves language, vision, embedding, and speech-to-text models.

Autoscaling

Scales inference replicas up and down with traffic.

Ollama-friendly

A familiar workflow for self-hosters already using Ollama.

Production ready

Built for serving ML models reliably in real deployments.

Apache-2.0 license

Enterprise-friendly open-source terms.

Advertisement
// run it

Run it yourself

  1. Step 1 — Clone the repo

    Download the source and move into the project folder.

    git clone https://github.com/kubeai-project/kubeai.git
    cd kubeai
  2. Step 2 — Check the README

    Every project documents its own setup; start with install requirements.

    cat README.md | head -60
  3. Step 3 — Run it

    Follow the project's launch command — Docker, pip, npm, or a binary release.

    # see README for the exact launch command
// use cases

What you can build

Advertisement
// faq

Questions, answered

Who maintains kubeai?

It is an open-source project at kubeai-project/kubeai with 137 forks. Check the repo's contributors and recent commits to see how active maintenance is.

Is kubeai free for commercial use?

Apache 2.0 licensed — commercial use allowed with attribution.

Do I need Kubernetes experience?

Yes — it is a Kubernetes operator, so a working cluster is the prerequisite.

What models can it serve?

LLMs, vision-language models, embeddings, and speech-to-text, among others.

How does autoscaling work?

It watches inference demand and adjusts model replicas automatically.

// keep exploring

Similar tools

Audio

Whisper

Robust Speech Recognition via Large-Scale Weak Supervision

★ 109.9k starsMIT
View guide →
Audio

Faster Whisper

Faster Whisper transcription with CTranslate2

★ 25.7k starsMIT
View guide →
Audio

whisper.cpp

Port of OpenAI's Whisper model in C/C++

★ 54.1k starsMIT
View guide →
Audio

StyleTTS2

Human-level text-to-speech through style diffusion and adversarial training with speech language models.

★ 6.4k starsMIT
View guide →
Audio

PaddleSpeech

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text…

★ 12.7k starsApache-2.0
View guide →
Audio

MOSS-TTS

MOSS-TTS family: open text-to-speech models for voice cloning, dialogue, voice design, and real-time agents

★ 4.2k starsApache-2.0
View guide →
// alternatives

Alternatives in Audio

The most-starred other Audio projects in the LibreAI catalogue — the realistic shortlist if kubeai is not the right fit.

Get kubeai

Free and open — grab the source, star the repo, and start creating.