Локальные LLM
GPT4All
GPT4All — run local LLMs on any device: a free desktop chat client and Python SDK that run open models entirely on your CPU, no GPU or cloud required
★ 77,4 тыс. звёздMIT
Смотреть руководство →lemonade — проект с открытым исходным кодом из категории «Локальные LLM» от lemonade-sdk (lemonade-sdk/lemonade на GitHub). У него 5 844 звезды на GitHub и 522 форка, он распространяется по лицензии Apache-2.0 и последний раз обновлялся на GitHub 8 октября 2026.
Discover and run local AI apps, serving optimized LLMs from your own GPU and NPU.
Decide which models you want to run locally — chat, image generation, speech or transcription — and check your GPU/NPU hardware.
Download the latest release installer for your platform (Windows, Debian and more) from GitHub Releases.
Use the CLI to list and pull a model from the built-in library, sized for your hardware.
Run the model and point your favorite app at the server's OpenAI-compatible API.
Serves optimized LLMs from your own GPU and NPU, with backends tuned per hardware configuration.
Connects to hundreds of apps through standard OpenAI, Anthropic and Ollama API surfaces.
One CLI runs chat models, image generation (SDXL-Turbo), speech generation (Kokoro) and transcription (Whisper) models.
Create model aliases and add multiple targets for instant active-standby failover between models.
A portable Embeddable Lemonade binary can be packaged into your own application to give it optimized local AI.
Ships an MCP server and can launch tools like Claude Code against your local models with lemonade launch.
Clone Lemonade if you want the source; most users install the release build for their platform.
git clone https://github.com/lemonade-sdk/lemonade.git
cd lemonadeInstall the latest release from GitHub, list the library, and pull a model that fits your hardware.
lemonade list
lemonade pull Gemma-4-E2B-it-GGUF # see README for the exact commandServe the model locally and call it through the OpenAI-compatible API.
lemonade run Gemma-4-E2B-it-GGUFLemonade is maintained by the lemonade-sdk organization and its community of committers and reviewers.
Yes — it is open source under the Apache-2.0 license, and the models it serves are downloaded from their respective publishers.
No. Models run on your own hardware; no cloud API key is involved.
Both serve local models with familiar APIs; Lemonade's emphasis is optimization for AMD GPUs and NPUs (Ryzen AI, Radeon, ROCm) plus a multimodal library and an embeddable build, and it can present an Ollama-compatible API itself.
Install the release build, run lemonade list, pull a model, and lemonade run it.
GPT4All — run local LLMs on any device: a free desktop chat client and Python SDK that run open models entirely on your CPU, no GPU or cloud required
Run local LLMs like Llama and DeepSeek right inside your web browser.
Find the best local models for your hardware — and how to run them.
Local API bridge to run Claude and Antigravity inside other coding clients.
Distribute and run LLMs with a single file.
Compile and run LLMs anywhere - phones, laptops, browsers and GPUs - with one engine
Другие проекты из категории «Локальные LLM» с наибольшим числом звёзд в каталоге LibreAI — реалистичный список альтернатив, если lemonade вам не подходит.
The simplest way to run open language models on your own machine.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
Соседние проекты из категории «Локальные LLM» в каталоге, ближайшие по числу звёзд к lemonade — продолжайте изучать полку по обе стороны от него.
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Google DeepMind's Gemma open-weight LLM library — install, load and chat with Gemma models in Python.
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots
Open-source AI sales OS — self-hosted CRM with native AI agents + WhatsApp (WAHA). Open alternative to Kommo, Octadesk & Intercom for any business that sells…
DeepSeek-Coder-V2 — DeepSeek's open code model family that challenged closed-source code models.
GGUF Quantization support for native ComfyUI models
Бесплатно и открыто — забирайте исходный код, ставьте звезду репозиторию и начинайте создавать.