Local LLM
handy-ollama
动手学Ollama，CPU玩转大模型部署，在线阅读地址：https://datawhalechina.github.io/handy-ollama/
★ 2.5k starsUnknown
View guide →Self-hosted LLM gateway routing across providers with cost controls.
Routerly is an open-source easy install project by Inebrio (Inebrio/Routerly on GitHub). It has 99 GitHub stars and 14 forks, is released under the AGPL-3.0 license, and was last updated on GitHub on 2 October 2026.
Self-host it following the official site guide.
Plug in your OpenAI, Anthropic, Gemini, and other keys.
Enforce spending limits per key or team.
Send all LLM traffic through the one gateway.
One endpoint for OpenAI, Anthropic, Gemini, Mistral, Ollama.
Hard caps keep AI spend under control.
See token usage per provider and key.
Your keys and traffic stay on your infra.
Drop-in proxy for existing app code.
AGPL-3.0 TypeScript codebase.
Download the source and enter the folder.
git clone https://github.com/Inebrio/Routerly.git
cd RouterlyInstall the Node.js dependencies.
npm installLaunch it and open the dashboard to add providers.
npm run startA self-hosted LLM gateway routing requests across AI providers with budgets, at Inebrio/Routerly.
OpenAI, Anthropic, Gemini, Mistral, and Ollama.
The source is open under AGPL-3.0; self-host it yourself.
You set spending caps and it blocks or reroutes over-budget traffic.
Your API keys and request data never pass through a third party.
动手学Ollama，CPU玩转大模型部署，在线阅读地址：https://datawhalechina.github.io/handy-ollama/
Clean web interface for chatting with your local Ollama models.
A no-install GUI for Ollama and other local LLM providers.
A self-hosted AI workout tracker with your own LLM.
Open source, OpenAI-compatible LLM gateway you run yourself.
Track LLM spend per user and feature inside your Rails app — no proxy.
The most-starred other Easy Install projects in the LibreAI catalogue — the realistic shortlist if Routerly is not the right fit.
A self-hosted dashboard that puts all your feeds in one place
CasaOS - A simple, easy-to-use, elegant open-source Personal Cloud system
Proxmox VE Helper-Scripts (Community Edition)
🚀 A self-hostable personal dashboard built for you. Includes status-checking, widgets, themes, icon packs, a UI editor and tons more!
Lightweight server monitoring with historical data, docker stats, and alerts.
Free and open — grab the source, star the repo, and start creating.