RAG & Wissen
private-gpt
Complete API layer for private AI apps on local models: RAG, skills, tools, MCP and text-to-SQL
★ 57,6 Tsd. SterneApache-2.0
Anleitung ansehen →llmware ist ein Open-Source-Projekt aus der Kategorie RAG & Wissen von llmware-ai (llmware-ai/llmware auf GitHub). Es hat 14.821 Sterne auf GitHub und 2.930 Forks, wird unter der Lizenz Apache-2.0 veröffentlicht und wurde zuletzt am 1. Oktober 2026 auf GitHub aktualisiert.
Unified framework for enterprise RAG pipelines with small, specialized models - local, private and secure.
Plan your pipeline around small, specialized on-device models for privacy and cost, adding a cloud model only for steps that truly need one.
Add the Python package to your environment; virtually all examples and models can run on a laptop.
Create a Library, add a folder of mixed documents (PDF, Office, text, images and more) to parse, chunk and index them, then install an embedding.
Run text, semantic or hybrid queries over the library and feed the results into a Prompt so answers are grounded in your documents, with evidence checks.
Access all models the same way through ModelCatalog, regardless of implementation - GGUF, OpenVINO, ONNX Runtime, Hugging Face, Sentence Transformers or API models.
50+ llmware fine-tuned SLIM, Bling, Dragon and Industry-BERT models (roughly 1-7B parameters) designed for RAG workflows and enterprise process-automation tasks on device.
The Library add_files function parses and chunks many formats - pdf, pptx, docx, xlsx, txt, csv, md, json, wav, png, jpg, html - routed automatically by file type.
Query libraries with text, semantic, hybrid and metadata-filtered queries, and mix and match embedding models and vector databases on the same library.
Attach files or query results directly to a Prompt as model-ready context, then run post-inference evidence checks against the sources.
Optimized for Windows, Mac and Linux across AI PC, laptop, edge and self-hosted deployments, including GPU and NPU acceleration paths.
Clone llmware for the full examples collection; most users install from PyPI instead.
git clone https://github.com/llmware-ai/llmware.git
cd llmwareInstall llmware into your Python environment.
pip install llmwareLoad a small catalog model and ask a question with context, following the README's ModelCatalog and Prompt examples.
python -c "from llmware.models import ModelCatalog; print(ModelCatalog().list_all_models())" # see README examples for the full workflowllmware is developed by llmware-ai (AI Bloks) with open-source contributors.
Yes. The framework is Apache-2.0 licensed; individual models in the catalog carry their own licenses.
No for local models: the catalog's open models run on your machine. Cloud models from OpenAI, Anthropic or Google are optional and would use your own keys.
Those are general orchestration frameworks that assume you bring models and infrastructure; llmware bundles an optimized model catalog of small local models with the full RAG pipeline in one opinionated framework.
Run pip install llmware, create a Library from a folder of documents, install an embedding, and run your first semantic query.
Complete API layer for private AI apps on local models: RAG, skills, tools, MCP and text-to-SQL
A low-code MCP framework for building complex, innovative RAG pipelines — visibly, not as a black box.
Ready-to-run templates for RAG, AI pipelines and enterprise search that stay in sync with live data
Local knowledge-base RAG and agent app built on LangChain with ChatGLM, Qwen and Llama models
Private document chat for attorneys: local LLMs, verifiable citations.
A private AI platform for agents, assistants and enterprise search over your documents
Die anderen Projekte der Kategorie RAG & Wissen mit den meisten Sternen im LibreAI-Katalog — die realistische Auswahl, falls llmware nicht das Richtige ist.
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or…
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context…
Lightweight OCR toolkit turning PDFs and images into structured, LLM-ready data in 100+ languages
MinerU — turns PDFs and Office documents into LLM-ready Markdown and JSON for agents and RAG pipelines, Apache-2.0 plus terms
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
Verwandte Projekte der Kategorie RAG & Wissen im Katalog, die llmware bei den Sternen am nächsten stehen — zum Weiterstöbern auf beiden Seiten.
Lightweight, lightning-fast in-process vector database from Alibaba that embeds in your app.
Local knowledge-base Q&A over PDFs, Office files, images and web pages - offline and CPU-friendly.
Air-gapped, open-source NotebookLM alternative that turns local documents into briefings, decks and podcasts.
The smallest vector index in the world: private RAG over everything on your laptop with 97% less storage.
A blazing-fast vector index in Rust, built on TurboQuant - with Python bindings
All-in-one AI framework for semantic search, LLM orchestration and language model workflows.
Kostenlos und offen — hol dir den Quellcode, gib dem Repository einen Stern und leg los.