Local LLM
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, anβ¦
β
60.1k starsCustom
View guide βGo-built AI gateway unifying many providers with routing and guardrails.
GoModel is an open-source local llm project by ENTERPILOT (ENTERPILOT/GoModel on GitHub). It has 1,212 GitHub stars and 110 forks, is released under the MIT license, and was last updated on GitHub on 4 October 2026.
Run the Go gateway on your infrastructure.
Add keys for the models you use.
Use the OpenAI-compatible endpoint.
Watch logs, costs, and failover in action.
OpenAI and Anthropic compatible endpoints.
OpenAI, Anthropic, Gemini, Groq, xAI, more.
Send requests to the best provider.
Policy controls on model traffic.
See spend per model and key.
Reroute when a provider struggles.
Download the source and move into the project folder.
git clone https://github.com/ENTERPILOT/GoModel.git
cd GoModelEvery project documents its own setup; start with install requirements.
cat README.md | head -60Follow the project's launch command β Docker, pip, npm, or a binary release.
# see README for the exact launch commandIt is a Go-native gateway with the same unified-API idea plus routing and observability.
MIT licensed β commercial use allowed.
Ollama and vLLM are named as supported backends.
Requests from a session route consistently; check the docs for details.
The project describes itself as production ready.
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, anβ¦
Open-source 24/7 Cowork app for OpenClaw, Hermes, Claude Code, Codex, OpenCode and 20+ more CLI Agent | Customize your assistants | Team them upο½Star if you β¦
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
A lightweight vLLM implementation built from scratch in about 1,200 readable lines of Python.
StepFun's open 196B MoE model that activates 11B parameters per token, built for fast agentic reasoning.
Rustunnel, in Rust β built for self-hosted, secure tunnel server in rust. expose local.
The most-starred other Local LLM projects in the LibreAI catalogue β the realistic shortlist if GoModel is not the right fit.
The simplest way to run open language models on your own machine.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
π€― LobeHub is your Chief Agent Operator, organizing your agents into 7Γ24 operations by hiring, scheduling, and reporting on your entire AI team.
Free and open β grab the source, star the repo, and start creating.