AionUi

The simplest way to run open language models on your own machine.

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

LLM inference in C/C++

A high-throughput and memory-efficient inference and serving engine for LLMs

🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.

Strata — one-click Qwen3.8-Flash-Next inference on consumer hardware: chat, code and images, locally, no account, MIT

Distribute and run LLMs with a single file.

Run a 70B LLM on a single 4GB GPU — layer-by-layer inference with almost no memory tricks skipped

An open-source RAG-based tool for chatting with your documents.

Hundreds of models & providers. One command to find what runs on your hardware.

Compile and run LLMs anywhere - phones, laptops, browsers and GPUs - with one engine