// rag · neuml/txtai

txtai

All-in-one AI framework for semantic search, LLM orchestration and language model workflows.

★ 13.0k stars⑂ 922 forksApache-2.0updated 2026-10
▦ visual — this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
// project facts

Project facts

txtai is an open-source rag & knowledge project by neuml (neuml/txtai on GitHub). It has 13,000 GitHub stars and 922 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 8 October 2026.

Repository
neuml/txtai
GitHub stars
13,000
Forks
922
License
Apache-2.0
Last updated on GitHub
8 October 2026
Listing
Full install guide
Official site
Official site
// how it works

How it works

  1. Start with search or a workflow

    Decide whether your first job is semantic search over content, a RAG pipeline, or a language-model workflow such as summarization or transcription.

  2. Install txtai

    Run pip install txtai (Python 3.11+); install only the optional dependencies your components need to keep the footprint low.

  3. Index your content

    Create an Embeddings instance and index text, documents, audio, images or video - sensible defaults get you running in a couple of lines.

  4. Build up to pipelines and agents

    Chain pipelines into workflows, ground an LLM with your embeddings for RAG, or connect components into an agent; optionally serve it all through the built-in API.

// features

Why people love it

Embeddings database

A union of sparse and dense vector indexes, graph networks and a relational database, enabling vector search with SQL, topic modeling, graph analysis and multimodal indexing.

Multimodal embeddings

Create embeddings for text, documents, audio, images and video, so mixed content lives in one searchable index.

Language-model pipelines

Ready pipelines run LLM prompts, question-answering, labeling, transcription, translation, summarization and more.

Workflows

Join pipelines together and aggregate business logic - from simple microservices to multi-model workflows.

Agents

Agents built on smolagents connect embeddings, pipelines, workflows and other agents, supporting Hugging Face, llama.cpp and LiteLLM-backed LLMs (OpenAI, Claude, Bedrock).

API and language bindings

A built-in FastAPI web API and MCP API, with bindings for JavaScript, Java, Rust and Go, so applications in any language can use a txtai service.

Advertisement
// run it

Run it yourself

  1. Clone the repository

    Clone txtai for the examples and source; most users install from PyPI instead.

    git clone https://github.com/neuml/txtai.git
    cd txtai
  2. Install from PyPI

    Install txtai into a Python 3.11+ virtual environment.

    pip install txtai
  3. Serve it as an API

    Point the built-in API at a YAML config and query it over HTTP.

    CONFIG=app.yml uvicorn "txtai.api:app"
    # then: curl "http://localhost:8000/search?query=positive"
// use cases

What you can build

Advertisement
// faq

Questions, answered

Who maintains txtai?

txtai is developed by NeuML, the company behind the project, with open-source contributors; NeuML also offers consulting and a hosted txtai.cloud.

Is txtai free to use?

Yes. It is open source under the Apache-2.0 license.

Does it need a paid API key?

Not for local models: txtai runs Hugging Face and llama.cpp models on your machine. Cloud LLMs reached through LiteLLM (OpenAI, Claude, AWS Bedrock) use your own provider keys.

How does txtai compare with LangChain or a standalone vector database?

A vector database only stores and searches embeddings, and LangChain orchestrates external components; txtai bundles the embeddings database, pipelines, workflows and agents into one framework with batteries included.

How do I get started?

Run pip install txtai, create an Embeddings index in a few lines, and work through the introductory notebook.

// keep exploring

Similar tools

RAG & Knowledge

infigraph

AST-powered code intelligence engine — graph database plus hybrid semantic search across 62 languages, zero LLM dependency.

★ 91 starsNOASSERTION
View guide →
RAG & Knowledge

trieve

All-in-one API platform for search, recommendations, RAG and analytics — self-hostable

★ 2.7k starsMIT
View guide →
RAG & Knowledge

Dify

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or…

★ 157.8k starsCustom (check repo)
View guide →
RAG & Knowledge

unstract

Unstract — LLM-driven extraction of unstructured data, built for API deployments and ETL pipeline workflows.

★ 7.3k starsAGPL-3.0
View guide →
RAG & Knowledge

pipeshub-ai

The open-source, permission-aware context layer that lets agents search all your company knowledge.

★ 3.8k starsApache-2.0
View guide →
RAG & Knowledge

vexor

Semantic search engine designed for files and code.

★ 242 starsMIT
View guide →
// alternatives

Alternatives in RAG & Knowledge

The most-starred other RAG & Knowledge projects in the LibreAI catalogue — the realistic shortlist if txtai is not the right fit.

Get txtai

Free and open — grab the source, star the repo, and start creating.