Lokale LLMs
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, an…
★ 60,1 Tsd. SterneCustom
Anleitung ansehen →GoModel ist ein Open-Source-Projekt aus der Kategorie Lokale LLMs von ENTERPILOT (ENTERPILOT/GoModel auf GitHub). Es hat 1.212 Sterne auf GitHub und 110 Forks, wird unter der Lizenz MIT veröffentlicht und wurde zuletzt am 4. Oktober 2026 auf GitHub aktualisiert.
Go-built AI gateway unifying many providers with routing and guardrails.
Run the Go gateway on your infrastructure.
Add keys for the models you use.
Use the OpenAI-compatible endpoint.
Watch logs, costs, and failover in action.
OpenAI and Anthropic compatible endpoints.
OpenAI, Anthropic, Gemini, Groq, xAI, more.
Send requests to the best provider.
Policy controls on model traffic.
See spend per model and key.
Reroute when a provider struggles.
Download the source and move into the project folder.
git clone https://github.com/ENTERPILOT/GoModel.git
cd GoModelEvery project documents its own setup; start with install requirements.
cat README.md | head -60Follow the project's launch command — Docker, pip, npm, or a binary release.
# see README for the exact launch commandIt is a Go-native gateway with the same unified-API idea plus routing and observability.
MIT licensed — commercial use allowed.
Ollama and vLLM are named as supported backends.
Requests from a session route consistently; check the docs for details.
The project describes itself as production ready.
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, an…
Open-source 24/7 Cowork app for OpenClaw, Hermes, Claude Code, Codex, OpenCode and 20+ more CLI Agent | Customize your assistants | Team them up｜Star if you …
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
A lightweight vLLM implementation built from scratch in about 1,200 readable lines of Python.
StepFun's open 196B MoE model that activates 11B parameters per token, built for fast agentic reasoning.
Rustunnel, in Rust — built for self-hosted, secure tunnel server in rust. expose local.
Die anderen Projekte der Kategorie Lokale LLMs mit den meisten Sternen im LibreAI-Katalog — die realistische Auswahl, falls GoModel nicht das Richtige ist.
The simplest way to run open language models on your own machine.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
Verwandte Projekte der Kategorie Lokale LLMs im Katalog, die GoModel bei den Sternen am nächsten stehen — zum Weiterstöbern auf beiden Seiten.
Open source AI agent harness in native Rust - GUI, CLI, webapp from one binary
Pack and deploy local AI agents designed for your team in minutes.
Clean web interface for chatting with your local Ollama models.
Secure MCP runtime letting AI agents operate your local machines.
Self-hosted local llm: turns phones into local ai agent runtimes with on-devic.
Local-first markdown editor that coding assistants can drive directly.
Kostenlos und offen — hol dir den Quellcode, gib dem Repository einen Stern und leg los.