Inverting the Generation Process of Denoising Diffusion Implicit Models: Empirical Evaluation and a Novel Method
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
This paper studies the problem of inverting the DDIM image generation process to recover latent variables, particularly the initial noise map, from a generated image. Existing methods often struggle with accuracy in this task. We propose a novel hybrid approach that combines direct inversion via gradient descent for the first step, followed by a fixed-point method for subsequent steps. Empirical evaluations across three datasets demonstrate that our method significantly improves the prediction of initial latent variables while achieving superior reconstruction accuracy. Additionally, we introduce a new evaluation, called the self-interpolation test, which assesses the quality of images generated from interpolated points between the true and predicted latent maps, offering deeper insights into performance. Our results reveal that while existing methods perform reasonably well in reconstruction, they consistently fail to accurately predict the initial latent variables, resulting in poor performance on the self-interpolation test. In contrast, our method outperforms all others across all metrics, providing valuable insights into diffusion models and enhancing their applications in image generation and editing.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 17 of its 18 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
17 of 18 references.
References · 17
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
5 more
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2014Understanding Deep Image Representations by Inverting Themcited by 403
- 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
- 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 128
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversioncited by 79
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024There and Back Again: On the relation between Noise and Image Inversions in Diffusion Models
- 2023Restoration based Generative Models
- 2022Deep Equilibrium Approaches to Diffusion Models
- 2022EDICT: Exact Diffusion Inversion via Coupled Transformations
- 2024Beta Sampling is All You Need: Efficient Image Generation Strategy for Diffusion Models using Stepwise Spectral Analysis
- 2024Diffusion Bridge Implicit Models
- 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision
- 2023Residual Denoising Diffusion Models