mlsanityData to 14 Oct 2026

DDGM: Solving inverse problems by Diffusive Denoising of Gradient-based Minimization

arXiv 2307.04946 ↗First posted 11 Jul 2023cs.CV cs.LG eess.IVcited by 2

Not on the map. Why?

Abstract (arXiv)

Inverse problems generally require a regularizer or prior for a good solution. A recent trend is to train a convolutional net to denoise images, and use this net as a prior when solving the inverse problem. Several proposals depend on a singular value decomposition of the forward operator, and several others backpropagate through the denoising net at runtime. Here we propose a simpler approach that combines the traditional gradient-based minimization of reconstruction error with denoising. Noise is also added at each step, so the iterative dynamics resembles a Langevin or diffusion process. Both the level of added noise and the size of the denoising step decay exponentially with time. We apply our method to the problem of tomographic reconstruction from electron micrographs acquired at multiple tilt angles. With empirical studies using simulated tilt views, we find parameter settings for our method that produce good results. We show that high accuracy can be achieved with as few as 50 denoising steps. We also compare with DDRM and DPS, more complex diffusion methods of the kinds mentioned above. These methods are less accurate (as measured by MSE and SSIM) for our tomography problem, even after the generation hyperparameters are optimized. Finally we extend our method to reconstruction of arbitrary-sized images and show results on 128 × 1568 pixel images

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 13 of its 25 references that are in the map. First posted on arXiv 11 Jul 2023.

Builds on

13 of 25 references.

References · 13

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2018Group Normalizationcited by 1,524
  5. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
  6. 2022Denoising Diffusion Restoration Modelscited by 963
  7. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
  8. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 508
  9. 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 286
  10. 2022Diffusion models as plug-and-play priorscited by 231
  11. 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
  12. 2023Unlimited-Size Diffusion Restorationcited by 15
1 more
  1. 2017Adversarial Image Alignment and Interpolationcited by 1

Built on by

Cited by year

Citing papers per year: 2024: 2.

2 papers.