Изображения
lite.ai.toolkit
A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.
★ 4,4 тыс. звёздGPL-3.0
Смотреть руководство →ControlNet — проект с открытым исходным кодом из категории «Изображения» от lllyasviel (lllyasviel/ControlNet на GitHub). У него 34 123 звезды на GitHub и 3 019 форков, он распространяется по лицензии Apache-2.0 и последний раз обновлялся на GitHub 25 февраля 2024.
ControlNet — the original conditional control for diffusion models: steer Stable Diffusion with edges, depth, pose and scribbles instead of prompts alone, Apache-2.0
Per the README: conda env create -f environment.yaml, then conda activate control.
Get the pretrained models and annotator detectors from the project Hugging Face page — SD models go in ControlNet/models, detectors in ControlNet/annotator/ckpts.
Run the app for your condition, e.g. python gradio_canny2image.py for edge control or gradio_pose2image.py for pose control, and generate in the browser UI.
Edges, depth, pose, segmentation, scribbles and line art become hard constraints the diffusion model must follow.
The base model stays frozen and safe; only the trainable copy learns the condition, so small datasets suffice.
One app per condition type, each with the relevant detector (Canny thresholds, OpenPose, MiDaS depth and others) built in.
Control weights can be transferred to customised Stable Diffusion checkpoints, as documented in the project discussions.
The README install path.
conda env create -f environment.yaml
conda activate controlDownload models and detectors from the Hugging Face page into the folders the README names.
https://huggingface.co/lllyasviel/ControlNetExample: Canny edge control in the browser.
python gradio_canny2image.pyLvmin Zhang (lllyasviel) and co-authors; this is the official implementation of the ControlNet paper (arXiv 2302.05543).
Yes — Apache-2.0 licensed. The base Stable Diffusion models it controls carry their own licences, which you should check separately.
For the original models and research code, this repo. For day-to-day generation, most people use the same ControlNet models through the A1111 extension or ComfyUI nodes, which are also listed on LibreAI.
Against plain Stable Diffusion prompting, ControlNet adds structural guarantees a prompt cannot give. Against IP-Adapter-style methods, ControlNet controls layout and pose from explicit maps, while adapters transfer style/subject from a reference image — many pipelines use both.
conda env create -f environment.yaml, activate control, download the models and detectors from Hugging Face, then run one of the gradio_*.py apps.
A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.
Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
Modular Stable Diffusion web UI that makes power tools accessible, fast, and extensible
Easily modify and tune a Stable Diffusion VAE
Scriptable command-line image and animation generator for Stable Diffusion
Stable Diffusion with Core ML on Apple Silicon
Другие проекты из категории «Изображения» с наибольшим числом звёзд в каталоге LibreAI — реалистичный список альтернатив, если ControlNet вам не подходит.
Stable Diffusion web UI
The node-graph powerhouse for precise, professional AI image and video generation.
High performance self-hosted photo and video management solution
PhotoCraft — a clean-room Photoshop reimplementation in pure Rust: layers, masks, adjustment layers, type, vectors, brushes and real PSD files, offline, MIT / Apache-2.0
Focus on prompting and generating
Соседние проекты из категории «Изображения» в каталоге, ближайшие по числу звёзд к ControlNet — продолжайте изучать полку по обе стороны от него.
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
Multi functional app to find duplicates, empty folders, similar images etc.
Real-ESRGAN — practical blind super-resolution for real-world photos and video: restores and upscales degraded images with models trained on pure synthetic data, BSD-3-Clause
State-of-the-art 2D and 3D Face Analysis Project
Animated sprite editor & pixel art tool (Windows, macOS, Linux)
A polished creative studio for professionals who want power without the node spaghetti.
Бесплатно и открыто — забирайте исходный код, ставьте звезду репозиторию и начинайте создавать.