RAG & Knowledge
llmware
Unified framework for enterprise RAG pipelines with small, specialized models - local, private and secure.
★ 14.8k starsApache-2.0
View guide →Complete API layer for private AI apps on local models: RAG, skills, tools, MCP and text-to-SQL
private-gpt is an open-source rag & knowledge project by zylon-ai (zylon-ai/private-gpt on GitHub). It has 57,562 GitHub stars and 7,620 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 8 October 2026.
Decide what you want from private-gpt and check the README and requirements to confirm it fits your setup and Python environment.
Clone the repository from GitHub (github.com/zylon-ai/private-gpt) or use the documented install channel if you do not need the source.
Follow the README quickstart to install dependencies and set any required configuration or credentials.
Work through the README's first example end to end, then adapt it to your own project or data.
A complete API layer for retrieval-augmented generation over your documents, fully private.
Supports skills, tools and MCP on top of local models.
Includes text-to-SQL capabilities for querying structured data in natural language.
Works with any OpenAI-compatible inference server, not one locked backend.
Offers a Claude-compatible API surface, per the README.
Designed for on-premise deployment so documents never leave your infrastructure.
Start by getting the source and entering the project directory.
git clone https://github.com/zylon-ai/private-gpt.git
cd private-gptOn macOS use Homebrew, or install as a uv tool with the project's wheel index.
brew install private-gptLaunch PrivateGPT and ingest documents through its API or UI.
private-gpt # see README for the exact commandIt is maintained by zylon-ai and contributors on GitHub, where the repository github.com/zylon-ai/private-gpt is the canonical home for code, issues and releases.
Yes — it is open source under the Apache-2.0 license. Read the license in the repository for what is permitted, including any conditions on redistribution or commercial use.
No paid key required — it runs local models through your chosen inference server.
Compared with Ollama or LM Studio alone: PrivateGPT adds the application API layer — RAG, tools, MCP and text-to-SQL — on top of a local inference server.
Clone github.com/zylon-ai/private-gpt, follow the README quickstart to install it, and run the documented first example before adapting it to your own work.
Unified framework for enterprise RAG pipelines with small, specialized models - local, private and secure.
Local knowledge-base RAG and agent app built on LangChain with ChatGLM, Qwen and Llama models
The smallest vector index in the world: private RAG over everything on your laptop with 97% less storage.
DeepSearcher — open-source deep research over your private data, with reasoning models and Milvus retrieval.
SQLBot — DataEase's conversational analytics: ask in natural language, get SQL answers via LLMs plus RAG.
A low-code MCP framework for building complex, innovative RAG pipelines — visibly, not as a black box.
The most-starred other RAG & Knowledge projects in the LibreAI catalogue — the realistic shortlist if private-gpt is not the right fit.
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or…
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context…
Lightweight OCR toolkit turning PDFs and images into structured, LLM-ready data in 100+ languages
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
Ready-to-run templates for RAG, AI pipelines and enterprise search that stay in sync with live data
Free and open — grab the source, star the repo, and start creating.