On Maximum-a-Posteriori estimation with Plug & Play priors and stochastic gradient descent
Not on the map. Why?
Abstract (arXiv)
Bayesian methods to solve imaging inverse problems usually combine an explicit data likelihood function with a prior distribution that explicitly models expected properties of the solution. Many kinds of priors have been explored in the literature, from simple ones expressing local properties to more involved ones exploiting image redundancy at a non-local scale. In a departure from explicit modelling, several recent works have proposed and studied the use of implicit priors defined by an image denoising algorithm. This approach, commonly known as Plug & Play (PnP) regularisation, can deliver remarkably accurate results, particularly when combined with state-of-the-art denoisers based on convolutional neural networks. However, the theoretical analysis of PnP Bayesian models and algorithms is difficult and works on the topic often rely on unrealistic assumptions on the properties of the image denoiser. This papers studies maximum-a-posteriori (MAP) estimation for Bayesian models with PnP priors. We first consider questions related to existence, stability and well-posedness, and then present a convergence proof for MAP computation by PnP stochastic gradient descent (PnP-SGD) under realistic assumptions on the denoiser used. We report a range of imaging experiments demonstrating PnP-SGD as well as comparisons with other PnP schemes.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 35 of its 81 references that are in the map. First posted on arXiv 16 Jan 2022.
Builds on
35 of 81 references.
References · 35
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2016Optimization Methods for Large-Scale Machine Learningcited by 1,140
- 2014Convex Optimization: Algorithms and Complexitycited by 569
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
- 2014Breaking the Curse of Dimensionality with Convex Neural Networkscited by 329
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
- 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 244
- 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
23 more
- 2015Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restorationcited by 194
- 2018A Sufficient Condition for Convergences of Adam and RMSPropcited by 124
- 2017Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problemscited by 107
- 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
- 2018Regularization by Denoising: Clarifications and New Interpretationscited by 102
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 96
- 2018DeepISP: Towards Learning an End-to-End Image Processing Pipelinecited by 88
- 2016Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreaucited by 83
- 2015Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolationcited by 78
- 2019Plug and play methods for magnetic resonance imaging (long version)cited by 75
- 2018An Online Plug-and-Play Algorithm for Regularized Image Reconstructioncited by 70
- 2020Learning Maximally Monotone Operators for Image Recoverycited by 62
- 2017Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibriumcited by 58
- 2020Regularization by Denoising via Fixed-Point Projection (RED-PRO)cited by 55
- 2020Scalable Plug-and-Play ADMM with Convergence Guaranteescited by 49
- 2017Unrolled Optimization with Deep Priorscited by 40
- 2020Provable Convergence of Plug-and-Play Priors with MMSE denoiserscited by 39
- 2018Scalable Bayesian uncertainty quantification in imaging inverse problems via convex optimizationcited by 22
- 2017Asymptotic Bias of Stochastic Gradient Searchcited by 19
- 2021Fixed-Point and Objective Convergence of Plug-and-Play Algorithmscited by 19
- 2016Maximum-a-posteriori estimation with Bayesian confidence regionscited by 10
- 2019Neumann Networks for Inverse Problems in Imagingcited by 9
- 2018Scene-Adapted Plug-and-Play Algorithm with Guaranteed Convergence: Applications to Data Fusion in Imagingcited by 5
Built on by
Citing papers per year: 2022: 4; 2023: 4; 2024: 3; 2025: 2; 2026: 1.
14 papers.
Sort:
- 2023Provable Probabilistic Imaging using Score-Based Generative Priorscited by 51
- 2022Learned reconstruction methods with convergence guaranteescited by 46
- 2024Plug-and-Play image restoration with Stochastic deNOising REgularizationcited by 17
- 2023Thin On-Sensor Nanophotonic Array Camerascited by 13
- 2022Deep Model-Based Super-Resolution with Non-uniform Blurcited by 10
- 2023Solving Linear Inverse Problems using Higher-Order Annealed Langevin Diffusioncited by 6
- 2024Learning pseudo-contractive denoisers for inverse problemscited by 6
- 2025MAP Estimation with Denoisers: Convergence Rates and Guaranteescited by 5
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithmscited by 4
- 2022Provably Convergent Plug & Play Linearized ADMM, applied to Deblurring Spatially Varying Kernelscited by 2
- 2026Beyond MMSE: Enhancing PnP Restoration with ProxiMAPcited by 2
- 2022Video Restoration with a Deep Plug-and-Play Priorcited by 1
- 2026Beyond MMSE: Enhancing PnP Restoration with ProxiMAP12 May 2026
- 2025Beyond sparse denoising in frames: minimax estimation with a scattering transform22 Oct 2025
- 2025MAP Estimation with Denoisers: Convergence Rates and Guarantees21 Jul 2025
- 2024Plug-and-Play Algorithm Convergence Analysis From The Standpoint of Stochastic Differential Equation22 Apr 2024
- 2024Learning pseudo-contractive denoisers for inverse problems8 Feb 2024
- 2024Plug-and-Play image restoration with Stochastic deNOising REgularization1 Feb 2024
- 2023Provable Probabilistic Imaging using Score-Based Generative Priors16 Oct 2023
- 2023Thin On-Sensor Nanophotonic Array Cameras5 Aug 2023
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithms25 May 2023
- 2023Solving Linear Inverse Problems using Higher-Order Annealed Langevin Diffusion8 May 2023
- 2022Provably Convergent Plug & Play Linearized ADMM, applied to Deblurring Spatially Varying Kernels19 Oct 2022
- 2022Video Restoration with a Deep Plug-and-Play Prior6 Sep 2022
2 more
- 2022Learned reconstruction methods with convergence guarantees11 Jun 2022
- 2022Deep Model-Based Super-Resolution with Non-uniform Blur21 Apr 2022
- 2023Provable Probabilistic Imaging using Score-Based Generative Priorscited by 51
- 2022Learned reconstruction methods with convergence guaranteescited by 46
- 2024Plug-and-Play image restoration with Stochastic deNOising REgularizationcited by 17
- 2023Thin On-Sensor Nanophotonic Array Camerascited by 13
- 2022Deep Model-Based Super-Resolution with Non-uniform Blurcited by 10
- 2023Solving Linear Inverse Problems using Higher-Order Annealed Langevin Diffusioncited by 6
- 2024Learning pseudo-contractive denoisers for inverse problemscited by 6
- 2025MAP Estimation with Denoisers: Convergence Rates and Guaranteescited by 5
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithmscited by 4
- 2022Provably Convergent Plug & Play Linearized ADMM, applied to Deblurring Spatially Varying Kernelscited by 2
- 2026Beyond MMSE: Enhancing PnP Restoration with ProxiMAPcited by 2
- 2022Video Restoration with a Deep Plug-and-Play Priorcited by 1
12 most cited of 14 All 14 (JSON)
- 2026Beyond MMSE: Enhancing PnP Restoration with ProxiMAP12 May 2026
- 2025Beyond sparse denoising in frames: minimax estimation with a scattering transform22 Oct 2025
- 2025MAP Estimation with Denoisers: Convergence Rates and Guarantees21 Jul 2025
- 2024Plug-and-Play Algorithm Convergence Analysis From The Standpoint of Stochastic Differential Equation22 Apr 2024
- 2024Learning pseudo-contractive denoisers for inverse problems8 Feb 2024
- 2024Plug-and-Play image restoration with Stochastic deNOising REgularization1 Feb 2024
- 2023Provable Probabilistic Imaging using Score-Based Generative Priors16 Oct 2023
- 2023Thin On-Sensor Nanophotonic Array Cameras5 Aug 2023
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithms25 May 2023
- 2023Solving Linear Inverse Problems using Higher-Order Annealed Langevin Diffusion8 May 2023
- 2022Provably Convergent Plug & Play Linearized ADMM, applied to Deblurring Spatially Varying Kernels19 Oct 2022
- 2022Video Restoration with a Deep Plug-and-Play Prior6 Sep 2022
12 newest of 14 All 14 (JSON)