Local LLM
MaxKB
🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。
★ 22.9k starsGPL-3.0
View guide →Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
anything-llm is an open-source rag & knowledge project by Mintplex-Labs (Mintplex-Labs/anything-llm on GitHub). It has 66,695 GitHub stars and 7,442 forks, is released under the MIT license, and was last updated on GitHub on 3 October 2026.
One binary or app gets you a working local model setup.
Pick a size that fits your RAM/VRAM; smaller models run on laptops.
Use the built-in UI, or point OpenAI-compatible clients at it.
Airplane mode works — your prompts never leave the device.
Pay nothing per token, ever.
Prompts and documents stay on your hardware, always.
RAG, tools, and agents build on the same base.
Smart compression runs big models on modest hardware.
Works on planes, in basements, behind firewalls.
Swap between hundreds of open models freely.
Download the source and move into the project folder.
git clone https://github.com/Mintplex-Labs/anything-llm.git
cd anything-llmEvery project documents its own setup; start with install requirements.
cat README.md | head -60Follow the project's launch command — Docker, pip, npm, or a binary release.
# see README for the exact launch commandIt is an open-source project at Mintplex-Labs/anything-llm with 7,442 forks. Check the repo's contributors and recent commits to see how active maintenance is.
MIT licensed — use it commercially, no strings attached.
Yes — with no network calls, there's nothing to leak.
Close on many tasks now; frontier cloud models still lead on hard reasoning.
8B models run on 16GB RAM; bigger models want a real GPU.
🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in productio…
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
An agent that finds anything on your computer — federated search over your files, in place.
A personal knowledge base that builds itself — drop in sources, get a persistent interlinked wiki.
Self-hosted rag & knowledge: 🧠 the brain for your ai — local-first memory engine for.
The most-starred other RAG & Knowledge projects in the LibreAI catalogue — the realistic shortlist if anything-llm is not the right fit.
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or…
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context…
Lightweight OCR toolkit turning PDFs and images into structured, LLM-ready data in 100+ languages
Ready-to-run templates for RAG, AI pipelines and enterprise search that stay in sync with live data
Complete API layer for private AI apps on local models: RAG, skills, tools, MCP and text-to-SQL
Free and open — grab the source, star the repo, and start creating.