Локальные LLM
Agent
Agent! now supports macOS 14.6 or later, Apple Silicon and Intel, latest release.
★ 642 звездыNOASSERTION
Смотреть руководство →omlx — проект с открытым исходным кодом из категории «Локальные LLM» от jundot (jundot/omlx на GitHub). У него 22 638 звёзд на GitHub и 1 985 форков, он распространяется по лицензии Apache-2.0 и последний раз обновлялся на GitHub 8 октября 2026.
A fast LLM inference server for Apple Silicon, managed from the macOS menu bar
You need an Apple Silicon Mac; pick the models that fit your unified memory.
Install the macOS app or the Homebrew package, or clone the repo for a source install.
Install with Homebrew, start the background service, and optionally add MCP support.
Point oMLX at your model directory, load a model, and query the OpenAI-compatible API.
Batches concurrent requests so multiple users or agents can share one Mac server efficiently.
Uses SSD caching alongside a tiered hot-and-cold KV cache to stretch Apple Silicon memory.
Start, stop and manage the server from the macOS menu bar or the brew services integration.
Serve several models at once, each with its own per-model settings.
Includes an admin dashboard and a built-in chat interface for quick testing.
Supports vision-language models and optional MCP (Model Context Protocol) integration.
Get the source code from GitHub and enter the project directory.
git clone https://github.com/jundot/omlx.git
cd omlxUse the project's Homebrew tap, then start oMLX as a background service.
brew tap jundot/omlx https://github.com/jundot/omlx
brew install jundot/omlx/omlx
omlx startRun the server attached to your terminal against a local model directory.
omlx serve --model-dir ~/modelsIt is maintained by jundot and contributors on GitHub.
Yes - oMLX is Apache-2.0 licensed and free to use.
No. It runs open models locally on your Mac, so there are no API keys or per-token costs.
Compared with Ollama, oMLX is MLX-native and macOS-focused, with continuous batching, SSD/tiered KV caching and menu-bar management. Compared with LM Studio, it is fully open source and server-oriented.
Install the macOS app or Homebrew package, run omlx start, load a model, and send a request to the OpenAI-compatible endpoint.
Agent! now supports macOS 14.6 or later, Apple Silicon and Intel, latest release.
BitNet — Microsoft's official inference framework for 1-bit large language models, running fast on ordinary CPUs, MIT
TokenSpeed — a speed-of-light LLM inference engine designed for agentic workloads, with TensorRT-LLM-level performance and vLLM-level usability
Run siliconscope locally: sudoless apple silicon system monitor (native swiftui g.
Run a 70B LLM on a single 4GB GPU — layer-by-layer inference with almost no memory tricks skipped
Alibaba's lightweight, blazing-fast inference engine for on-device LLMs and edge AI.
Другие проекты из категории «Локальные LLM» с наибольшим числом звёзд в каталоге LibreAI — реалистичный список альтернатив, если omlx вам не подходит.
The simplest way to run open language models on your own machine.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
Соседние проекты из категории «Локальные LLM» в каталоге, ближайшие по числу звёзд к omlx — продолжайте изучать полку по обе стороны от него.
🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。
High-performance In-browser LLM Inference Engine
Compile and run LLMs anywhere - phones, laptops, browsers and GPUs - with one engine
Qwen3-Coder - Alibaba's open code model series for agentic coding, up to 1M tokens of context
An open-source RAG-based tool for chatting with your documents.
Alibaba's lightweight, blazing-fast inference engine for on-device LLMs and edge AI.
Бесплатно и открыто — забирайте исходный код, ставьте звезду репозиторию и начинайте создавать.