Image Embedding for Denoising Generative Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Denoising Diffusion models are gaining increasing popularity in the field of generative modeling for several reasons, including the simple and stable training, the excellent generative quality, and the solid probabilistic foundation. In this article, we address the problem of em embedding an image into the latent space of Denoising Diffusion Models, that is finding a suitable ``noisy'' image whose denoising results in the original image. We particularly focus on Denoising Diffusion Implicit Models due to the deterministic nature of their reverse diffusion process. As a side result of our investigation, we gain a deeper insight into the structure of the latent space of diffusion models, opening interesting perspectives on its exploration, the definition of semantic trajectories, and the manipulation/conditioning of encodings for editing purposes. A particularly interesting property highlighted by our research, which is also characteristic of this class of generative models, is the independence of the latent representation from the networks implementing the reverse diffusion process. In other words, a common seed passed to different networks (each trained on the same dataset), eventually results in identical images.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 37 of its 44 references that are in the map. First posted on arXiv 30 Dec 2022.
Builds on
37 of 44 references.
Closest ancestors · 9
Same direction, newest first
- 2022Diffusion Models already have a Semantic Latent Space20 Oct
- 2022Understanding DDPM Latent Codes Through Optimal Transport14 Feb
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models6 Aug
- 2021Variational Diffusion Models1 Jul
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 28
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2022Video Diffusion Modelscited by 2,305
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2019An Introduction to Variational Autoencoderscited by 1,000
16 more
- 2022Simple Baselines for Image Restorationcited by 708
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
- 2021GAN Inversion: A Surveycited by 367
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
- 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
- 2020Semantic Photo Manipulation with a Generative Image Priorcited by 178
- 2016Inverting The Generator Of A Generative Adversarial Networkcited by 140
- 2016Invertible Conditional GANs for image editingcited by 118
- 2021A survey on Variational Autoencoders from a GreenAI perspectivecited by 22
- 2019Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Modelscited by 21
- 2019MimicGAN: Robust Projection onto Image Manifolds with Corruption Mimickingcited by 16
- 2022Comparing the latent space of generative modelscited by 12
- 2022Overparameterization Improves StyleGAN Inversioncited by 4
Built on by
Citing papers per year: 2023: 3; 2024: 0; 2025: 3; 2026: 1.
7 papers.
- 2023Precipitation nowcasting with generative diffusion modelscited by 23
- 2025Improved Immiscible Diffusion: Accelerate Diffusion Training by Reducing Its Miscibilitycited by 4
- 2025Controlling Ensemble Variance in Diffusion Models: An Application for Reanalyses Downscalingcited by 1
- 2026A Diffusion-Based Generative Prior Approach to Sparse-view Computed Tomographycited by 1
- 2023ELODIN: Naming Concepts in Embedding Spacescited by 0
- 2023Illumination and Shadows in Head Rotation: experiments with Denoising Diffusion Modelscited by 0
- 2025On the flow matching interpretabilitycited by 0
- 2026A Diffusion-Based Generative Prior Approach to Sparse-view Computed Tomography11 Feb 2026
- 2025On the flow matching interpretability24 Oct 2025
- 2025Improved Immiscible Diffusion: Accelerate Diffusion Training by Reducing Its Miscibility24 May 2025
- 2025Controlling Ensemble Variance in Diffusion Models: An Application for Reanalyses Downscaling21 Jan 2025
- 2023Precipitation nowcasting with generative diffusion models13 Aug 2023
- 2023Illumination and Shadows in Head Rotation: experiments with Denoising Diffusion Models11 Aug 2023
- 2023ELODIN: Naming Concepts in Embedding Spaces7 Mar 2023
Similar, not cited
Close in wording, no citation either way
- 2022Diffusion Models in Vision: A Survey
- 2025Automated Learning of Semantic Embedding Representations for Diffusion Models
- 2025Diffusion Models: A Mathematical Introduction
- 2023Diffusion Model for Generative Image Denoising
- 2022Representation Learning with Diffusion Models
- 2023Denoising Diffusion Bridge Models
- 2022Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidance
- 2023Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Models