Локальные LLM
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, an…
★ 60,1 тыс. звёздCustom
Смотреть руководство →GoModel — проект с открытым исходным кодом из категории «Локальные LLM» от ENTERPILOT (ENTERPILOT/GoModel на GitHub). У него 1 212 звёзд на GitHub и 110 форков, он распространяется по лицензии MIT и последний раз обновлялся на GitHub 4 октября 2026.
Go-built AI gateway unifying many providers with routing and guardrails.
Run the Go gateway on your infrastructure.
Add keys for the models you use.
Use the OpenAI-compatible endpoint.
Watch logs, costs, and failover in action.
OpenAI and Anthropic compatible endpoints.
OpenAI, Anthropic, Gemini, Groq, xAI, more.
Send requests to the best provider.
Policy controls on model traffic.
See spend per model and key.
Reroute when a provider struggles.
Download the source and move into the project folder.
git clone https://github.com/ENTERPILOT/GoModel.git
cd GoModelEvery project documents its own setup; start with install requirements.
cat README.md | head -60Follow the project's launch command — Docker, pip, npm, or a binary release.
# see README for the exact launch commandIt is a Go-native gateway with the same unified-API idea plus routing and observability.
MIT licensed — commercial use allowed.
Ollama and vLLM are named as supported backends.
Requests from a session route consistently; check the docs for details.
The project describes itself as production ready.
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, an…
Open-source 24/7 Cowork app for OpenClaw, Hermes, Claude Code, Codex, OpenCode and 20+ more CLI Agent | Customize your assistants | Team them up｜Star if you …
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
A lightweight vLLM implementation built from scratch in about 1,200 readable lines of Python.
StepFun's open 196B MoE model that activates 11B parameters per token, built for fast agentic reasoning.
Rustunnel, in Rust — built for self-hosted, secure tunnel server in rust. expose local.
Другие проекты из категории «Локальные LLM» с наибольшим числом звёзд в каталоге LibreAI — реалистичный список альтернатив, если GoModel вам не подходит.
The simplest way to run open language models on your own machine.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
Соседние проекты из категории «Локальные LLM» в каталоге, ближайшие по числу звёзд к GoModel — продолжайте изучать полку по обе стороны от него.
Open source AI agent harness in native Rust - GUI, CLI, webapp from one binary
Pack and deploy local AI agents designed for your team in minutes.
Clean web interface for chatting with your local Ollama models.
Secure MCP runtime letting AI agents operate your local machines.
Self-hosted local llm: turns phones into local ai agent runtimes with on-devic.
Local-first markdown editor that coding assistants can drive directly.
Бесплатно и открыто — забирайте исходный код, ставьте звезду репозиторию и начинайте создавать.