Bild
lite.ai.toolkit
A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.
★ 4,4 Tsd. SterneGPL-3.0
Anleitung ansehen →ControlNet ist ein Open-Source-Projekt aus der Kategorie Bild von lllyasviel (lllyasviel/ControlNet auf GitHub). Es hat 34.123 Sterne auf GitHub und 3.019 Forks, wird unter der Lizenz Apache-2.0 veröffentlicht und wurde zuletzt am 25. Februar 2024 auf GitHub aktualisiert.
ControlNet — the original conditional control for diffusion models: steer Stable Diffusion with edges, depth, pose and scribbles instead of prompts alone, Apache-2.0
Per the README: conda env create -f environment.yaml, then conda activate control.
Get the pretrained models and annotator detectors from the project Hugging Face page — SD models go in ControlNet/models, detectors in ControlNet/annotator/ckpts.
Run the app for your condition, e.g. python gradio_canny2image.py for edge control or gradio_pose2image.py for pose control, and generate in the browser UI.
Edges, depth, pose, segmentation, scribbles and line art become hard constraints the diffusion model must follow.
The base model stays frozen and safe; only the trainable copy learns the condition, so small datasets suffice.
One app per condition type, each with the relevant detector (Canny thresholds, OpenPose, MiDaS depth and others) built in.
Control weights can be transferred to customised Stable Diffusion checkpoints, as documented in the project discussions.
The README install path.
conda env create -f environment.yaml
conda activate controlDownload models and detectors from the Hugging Face page into the folders the README names.
https://huggingface.co/lllyasviel/ControlNetExample: Canny edge control in the browser.
python gradio_canny2image.pyLvmin Zhang (lllyasviel) and co-authors; this is the official implementation of the ControlNet paper (arXiv 2302.05543).
Yes — Apache-2.0 licensed. The base Stable Diffusion models it controls carry their own licences, which you should check separately.
For the original models and research code, this repo. For day-to-day generation, most people use the same ControlNet models through the A1111 extension or ComfyUI nodes, which are also listed on LibreAI.
Against plain Stable Diffusion prompting, ControlNet adds structural guarantees a prompt cannot give. Against IP-Adapter-style methods, ControlNet controls layout and pose from explicit maps, while adapters transfer style/subject from a reference image — many pipelines use both.
conda env create -f environment.yaml, activate control, download the models and detectors from Hugging Face, then run one of the gradio_*.py apps.
A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.
Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
Modular Stable Diffusion web UI that makes power tools accessible, fast, and extensible
Easily modify and tune a Stable Diffusion VAE
Scriptable command-line image and animation generator for Stable Diffusion
Stable Diffusion with Core ML on Apple Silicon
Die anderen Projekte der Kategorie Bild mit den meisten Sternen im LibreAI-Katalog — die realistische Auswahl, falls ControlNet nicht das Richtige ist.
Stable Diffusion web UI
The node-graph powerhouse for precise, professional AI image and video generation.
High performance self-hosted photo and video management solution
PhotoCraft — a clean-room Photoshop reimplementation in pure Rust: layers, masks, adjustment layers, type, vectors, brushes and real PSD files, offline, MIT / Apache-2.0
Focus on prompting and generating
Verwandte Projekte der Kategorie Bild im Katalog, die ControlNet bei den Sternen am nächsten stehen — zum Weiterstöbern auf beiden Seiten.
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
Multi functional app to find duplicates, empty folders, similar images etc.
Real-ESRGAN — practical blind super-resolution for real-world photos and video: restores and upscales degraded images with models trained on pure synthetic data, BSD-3-Clause
State-of-the-art 2D and 3D Face Analysis Project
Animated sprite editor & pixel art tool (Windows, macOS, Linux)
A polished creative studio for professionals who want power without the node spaghetti.
Kostenlos und offen — hol dir den Quellcode, gib dem Repository einen Stern und leg los.