// rag · llmware-ai/llmware

llmware

llmware é um projeto de RAG e conhecimento de código aberto de llmware-ai (llmware-ai/llmware no GitHub). Tem 14.821 estrelas no GitHub e 2.930 forks, é publicado sob a licença Apache-2.0 e foi atualizado pela última vez no GitHub em 1 de outubro de 2026.

Unified framework for enterprise RAG pipelines with small, specialized models - local, private and secure.

★ 14,8 mil estrelas⑂ 2,9 mil forksApache-2.0atualizado out 2026
▦ visual: o README deste projeto não inclui nenhuma captura incorporável,
então aqui vai um marcador. O guia abaixo está completo mesmo assim.
// dados do projeto

Dados do projeto

Repositório
llmware-ai/llmware
Estrelas no GitHub
14.821
Forks
2.930
Licença
Apache-2.0
Última atualização no GitHub
1 de outubro de 2026
Tipo de ficha
Guia de instalação completo
Site oficial
Official site
// como funciona

Como funciona

  1. Decide what runs locally

    Plan your pipeline around small, specialized on-device models for privacy and cost, adding a cloud model only for steps that truly need one.

  2. Install llmware

    Add the Python package to your environment; virtually all examples and models can run on a laptop.

  3. Build a library

    Create a Library, add a folder of mixed documents (PDF, Office, text, images and more) to parse, chunk and index them, then install an embedding.

  4. Query and prompt with sources

    Run text, semantic or hybrid queries over the library and feed the results into a Prompt so answers are grounded in your documents, with evidence checks.

// recursos

Por que as pessoas gostam tanto

300+ model catalog

Access all models the same way through ModelCatalog, regardless of implementation - GGUF, OpenVINO, ONNX Runtime, Hugging Face, Sentence Transformers or API models.

Small specialized models

50+ llmware fine-tuned SLIM, Bling, Dragon and Industry-BERT models (roughly 1-7B parameters) designed for RAG workflows and enterprise process-automation tasks on device.

Full document ingestion

The Library add_files function parses and chunks many formats - pdf, pptx, docx, xlsx, txt, csv, md, json, wav, png, jpg, html - routed automatically by file type.

Flexible retrieval

Query libraries with text, semantic, hybrid and metadata-filtered queries, and mix and match embedding models and vector databases on the same library.

Prompt with sources

Attach files or query results directly to a Prompt as model-ready context, then run post-inference evidence checks against the sources.

Runs anywhere

Optimized for Windows, Mac and Linux across AI PC, laptop, edge and self-hosted deployments, including GPU and NPU acceleration paths.

Advertisement
// execute você mesmo

Execute você mesmo

  1. Clone the repository

    Clone llmware for the full examples collection; most users install from PyPI instead.

    git clone https://github.com/llmware-ai/llmware.git
    cd llmware
  2. Install the package

    Install llmware into your Python environment.

    pip install llmware
  3. Run a first RAG example

    Load a small catalog model and ask a question with context, following the README's ModelCatalog and Prompt examples.

    python -c "from llmware.models import ModelCatalog; print(ModelCatalog().list_all_models())"  # see README examples for the full workflow
// casos de uso

O que você pode criar

Advertisement
// perguntas frequentes

Perguntas frequentes

Who maintains llmware?

llmware is developed by llmware-ai (AI Bloks) with open-source contributors.

Is llmware free to use?

Yes. The framework is Apache-2.0 licensed; individual models in the catalog carry their own licenses.

Does it need a paid API key?

No for local models: the catalog's open models run on your machine. Cloud models from OpenAI, Anthropic or Google are optional and would use your own keys.

How does llmware compare with LangChain or LlamaIndex?

Those are general orchestration frameworks that assume you bring models and infrastructure; llmware bundles an optimized model catalog of small local models with the full RAG pipeline in one opinionated framework.

How do I get started?

Run pip install llmware, create a Library from a folder of documents, install an embedding, and run your first semantic query.

// continue explorando

Ferramentas semelhantes

RAG e conhecimento

private-gpt

Complete API layer for private AI apps on local models: RAG, skills, tools, MCP and text-to-SQL

★ 57,6 mil estrelasApache-2.0
Ver o guia →
RAG e conhecimento

UltraRAG

A low-code MCP framework for building complex, innovative RAG pipelines — visibly, not as a black box.

★ 5,7 mil estrelasApache-2.0
Ver o guia →
RAG e conhecimento

llm-app

Ready-to-run templates for RAG, AI pipelines and enterprise search that stay in sync with live data

★ 58,8 mil estrelasMIT
Ver o guia →
RAG e conhecimento

Langchain-Chatchat

Local knowledge-base RAG and agent app built on LangChain with ChatGLM, Qwen and Llama models

★ 38,7 mil estrelasApache-2.0
Ver o guia →
RAG e conhecimento

docuchat.app

Private document chat for attorneys: local LLMs, verifiable citations.

★ 35 estrelasMIT
Ver o guia →
RAG e conhecimento

DocsGPT

A private AI platform for agents, assistants and enterprise search over your documents

★ 18,3 mil estrelasMIT
Ver o guia →
// alternativas

Alternativas em RAG e conhecimento

Os outros projetos de RAG e conhecimento com mais estrelas no catálogo do LibreAI — a lista realista de alternativas se llmware não for o ideal para você.

// mais em rag

Mais em RAG e conhecimento

Projetos de RAG e conhecimento próximos no catálogo, os mais próximos em estrelas de llmware: continue explorando dos dois lados dele.

Baixe o llmware

Grátis e aberto: pegue o código-fonte, dê uma estrela no repositório e comece a criar.