Local LLM
exo
Run frontier AI locally.
★ 47.7k starsApache-2.0
View guide →Cloud-native runtime for building and running agentic AI in production.
sre is an open-source local llm project by SmythOS (SmythOS/sre on GitHub). It has 1,299 GitHub stars and 204 forks, is released under the MIT license, and was last updated on GitHub on 3 April 2026.
Set it up locally or in your cloud.
Develop against the runtime's APIs.
Validate behavior before deploying.
Run on local, cloud, or edge.
Built for modern infrastructure.
Security as a runtime concern.
Compose agents from modules.
Aims beyond prototype stage.
Local, cloud, and edge targets.
Run and manage fleets of agents.
Download the source and move into the project folder.
git clone https://github.com/SmythOS/sre.git
cd sreEvery project documents its own setup; start with install requirements.
cat README.md | head -60Follow the project's launch command — Docker, pip, npm, or a binary release.
# see README for the exact launch commandIt is the open-source runtime; check smythos.com for the hosted offering.
MIT licensed — commercial use allowed.
Container-friendly design for modern deployment platforms.
Edge environments are named as targets; check the docs.
It is a runtime for deploying agents, not a chaining library.
Run frontier AI locally.
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, an…
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
A local-first OS for building and running AI agents.
Qwen3-Coder - Alibaba's open code model series for agentic coding, up to 1M tokens of context
StepFun's open 196B MoE model that activates 11B parameters per token, built for fast agentic reasoning.
The most-starred other Local LLM projects in the LibreAI catalogue — the realistic shortlist if sre is not the right fit.
The simplest way to run open language models on your own machine.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
Free and open — grab the source, star the repo, and start creating.