Lokale LLMs
GPT4All
GPT4All — run local LLMs on any device: a free desktop chat client and Python SDK that run open models entirely on your CPU, no GPU or cloud required
★ 77,4 Tsd. SterneMIT
Anleitung ansehen →lemonade ist ein Open-Source-Projekt aus der Kategorie Lokale LLMs von lemonade-sdk (lemonade-sdk/lemonade auf GitHub). Es hat 5.844 Sterne auf GitHub und 522 Forks, wird unter der Lizenz Apache-2.0 veröffentlicht und wurde zuletzt am 8. Oktober 2026 auf GitHub aktualisiert.
Discover and run local AI apps, serving optimized LLMs from your own GPU and NPU.
Decide which models you want to run locally — chat, image generation, speech or transcription — and check your GPU/NPU hardware.
Download the latest release installer for your platform (Windows, Debian and more) from GitHub Releases.
Use the CLI to list and pull a model from the built-in library, sized for your hardware.
Run the model and point your favorite app at the server's OpenAI-compatible API.
Serves optimized LLMs from your own GPU and NPU, with backends tuned per hardware configuration.
Connects to hundreds of apps through standard OpenAI, Anthropic and Ollama API surfaces.
One CLI runs chat models, image generation (SDXL-Turbo), speech generation (Kokoro) and transcription (Whisper) models.
Create model aliases and add multiple targets for instant active-standby failover between models.
A portable Embeddable Lemonade binary can be packaged into your own application to give it optimized local AI.
Ships an MCP server and can launch tools like Claude Code against your local models with lemonade launch.
Clone Lemonade if you want the source; most users install the release build for their platform.
git clone https://github.com/lemonade-sdk/lemonade.git
cd lemonadeInstall the latest release from GitHub, list the library, and pull a model that fits your hardware.
lemonade list
lemonade pull Gemma-4-E2B-it-GGUF # see README for the exact commandServe the model locally and call it through the OpenAI-compatible API.
lemonade run Gemma-4-E2B-it-GGUFLemonade is maintained by the lemonade-sdk organization and its community of committers and reviewers.
Yes — it is open source under the Apache-2.0 license, and the models it serves are downloaded from their respective publishers.
No. Models run on your own hardware; no cloud API key is involved.
Both serve local models with familiar APIs; Lemonade's emphasis is optimization for AMD GPUs and NPUs (Ryzen AI, Radeon, ROCm) plus a multimodal library and an embeddable build, and it can present an Ollama-compatible API itself.
Install the release build, run lemonade list, pull a model, and lemonade run it.
GPT4All — run local LLMs on any device: a free desktop chat client and Python SDK that run open models entirely on your CPU, no GPU or cloud required
Run local LLMs like Llama and DeepSeek right inside your web browser.
Find the best local models for your hardware — and how to run them.
Local API bridge to run Claude and Antigravity inside other coding clients.
Distribute and run LLMs with a single file.
Compile and run LLMs anywhere - phones, laptops, browsers and GPUs - with one engine
Die anderen Projekte der Kategorie Lokale LLMs mit den meisten Sternen im LibreAI-Katalog — die realistische Auswahl, falls lemonade nicht das Richtige ist.
The simplest way to run open language models on your own machine.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
Verwandte Projekte der Kategorie Lokale LLMs im Katalog, die lemonade bei den Sternen am nächsten stehen — zum Weiterstöbern auf beiden Seiten.
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Google DeepMind's Gemma open-weight LLM library — install, load and chat with Gemma models in Python.
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots
Open-source AI sales OS — self-hosted CRM with native AI agents + WhatsApp (WAHA). Open alternative to Kommo, Octadesk & Intercom for any business that sells…
DeepSeek-Coder-V2 — DeepSeek's open code model family that challenged closed-source code models.
GGUF Quantization support for native ComfyUI models
Kostenlos und offen — hol dir den Quellcode, gib dem Repository einen Stern und leg los.