Local LLM
Ollama
The simplest way to run open language models on your own machine.
★ 182.1k starsMIT
View guide →AI e-book reader with semantic search, RAG chat, notes, and text-to-speech.
ReadAny is an open-source local llm project by codedogQBY (codedogQBY/ReadAny on GitHub). It has 2,704 GitHub stars and 217 forks, is released under the Custom license, and was last updated on GitHub on 26 September 2026.
Get the app for your platform.
Import EPUBs and other e-book formats.
Ask questions or search semantically.
Keep library and notes synced via WebDAV.
Ask questions answered from your books.
Find passages by meaning, not keywords.
Embeddings stay on your device.
Annotate as you read.
Listen to your books read aloud.
Sync library across devices.
Download the source and move into the project folder.
git clone https://github.com/codedogQBY/ReadAny.git
cd ReadAnyEvery project documents its own setup; start with install requirements.
cat README.md | head -60Follow the project's launch command — Docker, pip, npm, or a binary release.
# see README for the exact launch commandEPUB reading is the focus; check the docs for other formats.
Custom license — read the repo's license file first.
It supports Anthropic and other providers; check for local model options.
Your books are embedded locally and answers are grounded in their text.
Yes, WebDAV sync keeps library and notes consistent.
The simplest way to run open language models on your own machine.
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
An open-source RAG-based tool for chatting with your documents.
Private AI chat and model studio that runs in your browser via WebGPU.
A cautious, explainable AI-like text risk analysis tool for local workflows and coding
Open bilingual (Chinese-English) 6B chat LLM with 32K-context variant and low-memory INT4 inference.
The most-starred other Local LLM projects in the LibreAI catalogue — the realistic shortlist if ReadAny is not the right fit.
The simplest way to run open language models on your own machine.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
Free and open — grab the source, star the repo, and start creating.