Imagem
lite.ai.toolkit
A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.
★ 4,4 mil estrelasGPL-3.0
Ver o guia →ControlNet é um projeto de imagem de código aberto de lllyasviel (lllyasviel/ControlNet no GitHub). Tem 34.123 estrelas no GitHub e 3.019 forks, é publicado sob a licença Apache-2.0 e foi atualizado pela última vez no GitHub em 25 de fevereiro de 2024.
ControlNet — the original conditional control for diffusion models: steer Stable Diffusion with edges, depth, pose and scribbles instead of prompts alone, Apache-2.0
Per the README: conda env create -f environment.yaml, then conda activate control.
Get the pretrained models and annotator detectors from the project Hugging Face page — SD models go in ControlNet/models, detectors in ControlNet/annotator/ckpts.
Run the app for your condition, e.g. python gradio_canny2image.py for edge control or gradio_pose2image.py for pose control, and generate in the browser UI.
Edges, depth, pose, segmentation, scribbles and line art become hard constraints the diffusion model must follow.
The base model stays frozen and safe; only the trainable copy learns the condition, so small datasets suffice.
One app per condition type, each with the relevant detector (Canny thresholds, OpenPose, MiDaS depth and others) built in.
Control weights can be transferred to customised Stable Diffusion checkpoints, as documented in the project discussions.
The README install path.
conda env create -f environment.yaml
conda activate controlDownload models and detectors from the Hugging Face page into the folders the README names.
https://huggingface.co/lllyasviel/ControlNetExample: Canny edge control in the browser.
python gradio_canny2image.pyLvmin Zhang (lllyasviel) and co-authors; this is the official implementation of the ControlNet paper (arXiv 2302.05543).
Yes — Apache-2.0 licensed. The base Stable Diffusion models it controls carry their own licences, which you should check separately.
For the original models and research code, this repo. For day-to-day generation, most people use the same ControlNet models through the A1111 extension or ComfyUI nodes, which are also listed on LibreAI.
Against plain Stable Diffusion prompting, ControlNet adds structural guarantees a prompt cannot give. Against IP-Adapter-style methods, ControlNet controls layout and pose from explicit maps, while adapters transfer style/subject from a reference image — many pipelines use both.
conda env create -f environment.yaml, activate control, download the models and detectors from Hugging Face, then run one of the gradio_*.py apps.
A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.
Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
Modular Stable Diffusion web UI that makes power tools accessible, fast, and extensible
Easily modify and tune a Stable Diffusion VAE
Scriptable command-line image and animation generator for Stable Diffusion
Stable Diffusion with Core ML on Apple Silicon
Os outros projetos de Imagem com mais estrelas no catálogo do LibreAI — a lista realista de alternativas se ControlNet não for o ideal para você.
Stable Diffusion web UI
The node-graph powerhouse for precise, professional AI image and video generation.
High performance self-hosted photo and video management solution
PhotoCraft — a clean-room Photoshop reimplementation in pure Rust: layers, masks, adjustment layers, type, vectors, brushes and real PSD files, offline, MIT / Apache-2.0
Focus on prompting and generating
Projetos de Imagem próximos no catálogo, os mais próximos em estrelas de ControlNet: continue explorando dos dois lados dele.
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
Multi functional app to find duplicates, empty folders, similar images etc.
Real-ESRGAN — practical blind super-resolution for real-world photos and video: restores and upscales degraded images with models trained on pure synthetic data, BSD-3-Clause
State-of-the-art 2D and 3D Face Analysis Project
Animated sprite editor & pixel art tool (Windows, macOS, Linux)
A polished creative studio for professionals who want power without the node spaghetti.
Grátis e aberto: pegue o código-fonte, dê uma estrela no repositório e comece a criar.