Local LLM
GPT4All
GPT4All — run local LLMs on any device: a free desktop chat client and Python SDK that run open models entirely on your CPU, no GPU or cloud required
★ 77.4k starsMIT
View guide →Discover and run local AI apps, serving optimized LLMs from your own GPU and NPU.
lemonade is an open-source local llm project by lemonade-sdk (lemonade-sdk/lemonade on GitHub). It has 5,844 GitHub stars and 522 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 8 October 2026.
Decide which models you want to run locally — chat, image generation, speech or transcription — and check your GPU/NPU hardware.
Download the latest release installer for your platform (Windows, Debian and more) from GitHub Releases.
Use the CLI to list and pull a model from the built-in library, sized for your hardware.
Run the model and point your favorite app at the server's OpenAI-compatible API.
Serves optimized LLMs from your own GPU and NPU, with backends tuned per hardware configuration.
Connects to hundreds of apps through standard OpenAI, Anthropic and Ollama API surfaces.
One CLI runs chat models, image generation (SDXL-Turbo), speech generation (Kokoro) and transcription (Whisper) models.
Create model aliases and add multiple targets for instant active-standby failover between models.
A portable Embeddable Lemonade binary can be packaged into your own application to give it optimized local AI.
Ships an MCP server and can launch tools like Claude Code against your local models with lemonade launch.
Clone Lemonade if you want the source; most users install the release build for their platform.
git clone https://github.com/lemonade-sdk/lemonade.git
cd lemonadeInstall the latest release from GitHub, list the library, and pull a model that fits your hardware.
lemonade list
lemonade pull Gemma-4-E2B-it-GGUF # see README for the exact commandServe the model locally and call it through the OpenAI-compatible API.
lemonade run Gemma-4-E2B-it-GGUFLemonade is maintained by the lemonade-sdk organization and its community of committers and reviewers.
Yes — it is open source under the Apache-2.0 license, and the models it serves are downloaded from their respective publishers.
No. Models run on your own hardware; no cloud API key is involved.
Both serve local models with familiar APIs; Lemonade's emphasis is optimization for AMD GPUs and NPUs (Ryzen AI, Radeon, ROCm) plus a multimodal library and an embeddable build, and it can present an Ollama-compatible API itself.
Install the release build, run lemonade list, pull a model, and lemonade run it.
GPT4All — run local LLMs on any device: a free desktop chat client and Python SDK that run open models entirely on your CPU, no GPU or cloud required
Run local LLMs like Llama and DeepSeek right inside your web browser.
Find the best local models for your hardware — and how to run them.
Distribute and run LLMs with a single file.
Compile and run LLMs anywhere - phones, laptops, browsers and GPUs - with one engine
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
The most-starred other Local LLM projects in the LibreAI catalogue — the realistic shortlist if lemonade is not the right fit.
The simplest way to run open language models on your own machine.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
Free and open — grab the source, star the repo, and start creating.