Lokale LLMs
llama.cpp
LLM inference in C/C++
★ 130,2 Tsd. SterneMIT
Anleitung ansehen →whatcanirun ist ein Open-Source-Projekt aus der Kategorie Lokale LLMs von fiveoutofnine (fiveoutofnine/whatcanirun auf GitHub). Es hat 247 Sterne auf GitHub und 23 Forks, wird unter der Lizenz MIT veröffentlicht und wurde zuletzt am 26. August 2026 auf GitHub aktualisiert.
Find the best local models for your hardware — and how to run them.
Clone the repo or visit the official site to get started.
The README documents install requirements and configuration.
Connect your own API keys where the project requires them.
Launch the app and start using it.
Recommends models that fit your RAM and chip — no VRAM guesswork.
Focused on the two stacks that run best on consumer hardware.
Get the exact run command for each recommended model.
Tuned for M-series Macs where most local inference happens.
Sets expectations on tokens-per-second before you download gigabytes.
Free and open — fork it or self-host the picker.
Download the source and move into the project folder.
git clone https://github.com/fiveoutofnine/whatcanirun.git
cd whatcanirunEvery project documents its own setup; start with install requirements.
cat README.md | head -60Follow the project's launch command — Docker, pip, npm, or a binary release.
# see README for the exact launch commandYes — MIT licensed and free to use.
Built primarily around Apple Silicon Macs and llama.cpp-compatible setups.
It recommends and gives commands; you run them yourself.
MLX is fastest on Apple Silicon; llama.cpp runs almost anywhere. The tool covers both.
It is open source — check the repo for contribution notes.
LLM inference in C/C++
The simplest way to run open language models on your own machine.
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer
Hundreds of models & providers. One command to find what runs on your hardware.
GPT4All — run local LLMs on any device: a free desktop chat client and Python SDK that run open models entirely on your CPU, no GPU or cloud required
Noise-robust subtitle generator powered by Whisper and local ASR models.
Die anderen Projekte der Kategorie Lokale LLMs mit den meisten Sternen im LibreAI-Katalog — die realistische Auswahl, falls whatcanirun nicht das Richtige ist.
The simplest way to run open language models on your own machine.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
Verwandte Projekte der Kategorie Lokale LLMs im Katalog, die whatcanirun bei den Sternen am nächsten stehen — zum Weiterstöbern auf beiden Seiten.
Token efficient translation utility built on ChatGPT or any OpenAI compatible LLM.
The simplest way to run open language models on your own machine.
Self-hosted control plane: approve or block rogue agent calls.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Pentest Harness — Heaven for Hackers.
LLM inference in C/C++
Kostenlos und offen — hol dir den Quellcode, gib dem Repository einen Stern und leg los.