Stable Diffusion Learning Path

Stable Diffusion overview and release history

Stable Diffusion is a deep learning text-to-image (and related) generative model released in 2022 that creates images from text prompts using diffusion techniques. It is a latent diffusion model composed of a variational autoencoder (VAE), a U-Net denoiser, and an optional text encoder (commonly a pretrained CLIP text encoder). The model works by iteratively denoising random noise in a compressed latent space until an image is formed, and it can also support image editing tasks such as inpainting and outpainting, as well as image-to-image transformations guided by text. Its release history includes a progression of model variants that improve resolution and architecture. The latest release mentioned is SD 3.5 (model), released on October 22, 2024, following the original Stable Diffusion release on August 22, 2022. Major milestones described include SD XL (with a refiner) released alongside SD XL 1.0 in July 2023, which introduced native 1024×1024 generation and improved handling of details like limbs and text, and SD 3.0, which changed the backbone from a U-Net to a Rectified Flow Transformer (MMDiT) approach. Overall, the public release of code and model weights enabled running the model on consumer hardware with relatively modest GPU requirements, marking a shift away from earlier proprietary, cloud-only text-to-image systems.

0/2 modes complete

Diffusion models and latent diffusion concept

0/2 modes complete