LibreAI / Self-Hosted / awesome-local-llm
// selfhosted · rafska/awesome-local-llm

awesome-local-llm

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

★ 2.9k stars⑂ 428 forksMITupdated 2026-10
▦ visual — this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
// project facts

Project facts

awesome-local-llm is an open-source self-hosted project by rafska (rafska/awesome-local-llm on GitHub). It has 2,928 GitHub stars and 428 forks, is released under the MIT license, and was last updated on GitHub on 3 October 2026.

GitHub stars
2,928
Forks
428
License
MIT
Last updated on GitHub
3 October 2026
Category
Self-Hosted
Listing
Full install guide
Official site
GitHub repo
// how it works

How it works

  1. Pick a service to reclaim

    Files, mail, passwords, media — start with one.

  2. Deploy it

    Docker Compose one-liners are the standard install.

  3. Point a domain at it

    Reverse proxy + free TLS certificates take minutes.

  4. Back it up

    Automated backups to a second disk or offsite.

// features

Why people love it

LLM-powered

Large language models drive its smartest features, locally or via API.

Self-hosted by design

Runs on your own server — your data never has to leave your infrastructure.

Offline resilient

Works on your LAN even when the internet dies.

Private by default

No accounts with data brokers required.

Docker simplicity

Compose files make installs reproducible.

One-time cost

A mini-PC beats endless subscriptions.

Advertisement
// run it

Run it yourself

  1. Step 1 — Clone the repo

    Download the source and move into the project folder.

    git clone https://github.com/rafska/awesome-local-llm.git
    cd awesome-local-llm
  2. Step 2 — Check the README

    Every project documents its own setup; start with install requirements.

    cat README.md | head -60
  3. Step 3 — Run it

    Follow the project's launch command — Docker, pip, npm, or a binary release.

    # see README for the exact launch command
// use cases

What you can build

Advertisement
// faq

Questions, answered

Who maintains awesome-local-llm?

It is an open-source project at rafska/awesome-local-llm with 428 forks. Check the repo's contributors and recent commits to see how active maintenance is.

Is awesome-local-llm free for commercial use?

MIT licensed — use it commercially, no strings attached.

What hardware do I need?

A Raspberry Pi 5 or old laptop handles most of these.

Can non-technical family use it?

Yes — the apps look and feel like the SaaS versions.

What about backups?

Non-negotiable: automate offsite backups from day one.

// keep exploring

Similar tools

Self-Hosted

streama

Self hosted streaming media server. https://docs.streama-project.com/

★ 9.8k starsMIT
View guide →
Self-Hosted

lesspass

:key: stateless open source password manager

★ 6.1k starsGPL-3.0
View guide →
Self-Hosted

lmnr

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

★ 3.3k starsApache-2.0
View guide →
Self-Hosted

awesome-selfhosted

A list of Free Software network services and web applications which can be hosted on your own servers

★ 323.7k starsUnknown
View guide →
Self-Hosted

Home Assistant

Home Assistant — open-source home automation that puts local control and privacy first: thousands of integrations, automations and dashboards on your own hardware

★ 91.6k starsApache-2.0
View guide →
Self-Hosted

a-eye

Self-hosted AI photo intelligence: tag, rename, and search photos locally.

★ 107 starsCustom
View guide →
// alternatives

Alternatives in Self-Hosted

The most-starred other Self-Hosted projects in the LibreAI catalogue — the realistic shortlist if awesome-local-llm is not the right fit.

Get awesome-local-llm

Free and open — grab the source, star the repo, and start creating.