Local LLM
Unsloth
Run and fine-tune LLMs and diffusion models locally — faster training, smaller memory footprint.
★ 77.2k starsApache-2.0
View guide →The simplest way to run open language models on your own machine.
Ollama is an open-source local llm project by ollama (ollama/ollama on GitHub). It has 182,098 GitHub stars and 18,090 forks, is released under the MIT license, and was last updated on GitHub on 3 October 2026.
macOS and Linux use the install script; Windows uses a one-line PowerShell command. Desktop downloads exist too.
Type ollama run followed by a model name — your first run downloads the weights, then you are chatting.
Point coding agents, chat apps, and your own code at Ollama's local API instead of a cloud endpoint.
Pull new models anytime with ollama pull and switch between them freely.
macOS, Windows, Linux, and Docker — up and running in about a minute.
Llama, Qwen, Gemma, DeepSeek, gpt-oss, Kimi, GLM, MiniMax, Mistral, and more, in multiple sizes.
An OpenAI-style local endpoint your apps and agents can call with zero cloud dependency.
Works with Claude Code, Codex, Copilot CLI, OpenCode, OpenClaw, and other harnesses.
Turn it into a personal assistant across WhatsApp, Telegram, Slack, and Discord.
First-party Python and JavaScript libraries plus a big community ecosystem.
macOS / Linux: run the install script. Windows: run the PowerShell one-liner.
curl -fsSL https://ollama.com/install.sh | sh
# Windows PowerShell:
irm https://ollama.com/install.ps1 | iexStart chatting with any model from the library.
ollama run gemma4Call the local API from your app, or launch an integration such as a coding agent.
ollama launch claudeYes — MIT licensed, free for personal and commercial use, with no account required.
No — it runs on CPU too, though a GPU makes larger models much faster. Smaller models fly even on modest machines.
Ollama is the easiest way to run models. Unsloth adds training and fine-tuning. Many people use Ollama to run what Unsloth helped them train.
The library lists sizes and strengths per model — start small (a few GB) and scale up if your machine handles it.
Yes — the local API plus official Python/JS libraries make it a popular backend for indie AI apps.
Run and fine-tune LLMs and diffusion models locally — faster training, smaller memory footprint.
A one-click browser for open-source AI apps — discover, install, and run anything.
Alibaba's open voice models: expressive, streaming-capable speech with free-form voice design.
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Discover and run local AI apps, serving optimized LLMs from your own GPU and NPU.
The most-starred other Local LLM projects in the LibreAI catalogue — the realistic shortlist if Ollama is not the right fit.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
GPT4All — run local LLMs on any device: a free desktop chat client and Python SDK that run open models entirely on your CPU, no GPU or cloud required
Free and open — grab the source, star the repo, and start creating.