mlsanityData to 7 Oct 2026

On Maximum-a-Posteriori estimation with Plug & Play priors and stochastic gradient descent

arXiv 2201.06133 ↗First posted 16 Jan 2022stat.ML cs.CV cs.LGcited by 14

Not on the map. Why?

Abstract (arXiv)

Bayesian methods to solve imaging inverse problems usually combine an explicit data likelihood function with a prior distribution that explicitly models expected properties of the solution. Many kinds of priors have been explored in the literature, from simple ones expressing local properties to more involved ones exploiting image redundancy at a non-local scale. In a departure from explicit modelling, several recent works have proposed and studied the use of implicit priors defined by an image denoising algorithm. This approach, commonly known as Plug & Play (PnP) regularisation, can deliver remarkably accurate results, particularly when combined with state-of-the-art denoisers based on convolutional neural networks. However, the theoretical analysis of PnP Bayesian models and algorithms is difficult and works on the topic often rely on unrealistic assumptions on the properties of the image denoiser. This papers studies maximum-a-posteriori (MAP) estimation for Bayesian models with PnP priors. We first consider questions related to existence, stability and well-posedness, and then present a convergence proof for MAP computation by PnP stochastic gradient descent (PnP-SGD) under realistic assumptions on the denoiser used. We report a range of imaging experiments demonstrating PnP-SGD as well as comparisons with other PnP schemes.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 35 of its 81 references that are in the map. First posted on arXiv 16 Jan 2022.

Builds on

35 of 81 references.

References · 35

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  3. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  4. 2016Optimization Methods for Large-Scale Machine Learningcited by 1,140
  5. 2014Convex Optimization: Algorithms and Complexitycited by 569
  6. 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
  7. 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
  8. 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
  9. 2014Breaking the Curse of Dimensionality with Convex Neural Networkscited by 329
  10. 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
  11. 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 244
  12. 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
23 more
  1. 2015Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restorationcited by 194
  2. 2018A Sufficient Condition for Convergences of Adam and RMSPropcited by 124
  3. 2017Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problemscited by 107
  4. 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
  5. 2018Regularization by Denoising: Clarifications and New Interpretationscited by 102
  6. 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 96
  7. 2018DeepISP: Towards Learning an End-to-End Image Processing Pipelinecited by 88
  8. 2016Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreaucited by 83
  9. 2015Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolationcited by 78
  10. 2019Plug and play methods for magnetic resonance imaging (long version)cited by 75
  11. 2018An Online Plug-and-Play Algorithm for Regularized Image Reconstructioncited by 70
  12. 2020Learning Maximally Monotone Operators for Image Recoverycited by 62
  13. 2017Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibriumcited by 58
  14. 2020Regularization by Denoising via Fixed-Point Projection (RED-PRO)cited by 55
  15. 2020Scalable Plug-and-Play ADMM with Convergence Guaranteescited by 49
  16. 2017Unrolled Optimization with Deep Priorscited by 40
  17. 2020Provable Convergence of Plug-and-Play Priors with MMSE denoiserscited by 39
  18. 2018Scalable Bayesian uncertainty quantification in imaging inverse problems via convex optimizationcited by 22
  19. 2017Asymptotic Bias of Stochastic Gradient Searchcited by 19
  20. 2021Fixed-Point and Objective Convergence of Plug-and-Play Algorithmscited by 19
  21. 2016Maximum-a-posteriori estimation with Bayesian confidence regionscited by 10
  22. 2019Neumann Networks for Inverse Problems in Imagingcited by 9
  23. 2018Scene-Adapted Plug-and-Play Algorithm with Guaranteed Convergence: Applications to Data Fusion in Imagingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 4; 2024: 3; 2025: 2; 2026: 1.

14 papers.

Sort: