Gradient Step Denoiser for convergent Plug-and-Play
Not on the map. Why?
Abstract (arXiv)
Plug-and-Play methods constitute a class of iterative algorithms for imaging problems where regularization is performed by an off-the-shelf denoiser. Although Plug-and-Play methods can lead to tremendous visual performance for various image problems, the few existing convergence guarantees are based on unrealistic (or suboptimal) hypotheses on the denoiser, or limited to strongly convex data terms. In this work, we propose a new type of Plug-and-Play methods, based on half-quadratic splitting, for which the denoiser is realized as a gradient descent step on a functional parameterized by a deep neural network. Exploiting convergence results for proximal gradient descent algorithms in the non-convex setting, we show that the proposed Plug-and-Play algorithm is a convergent iterative scheme that targets stationary points of an explicit global functional. Besides, experiments show that it is possible to learn such a deep denoiser while not compromising the performance in comparison to other state-of-the-art deep denoisers used in Plug-and-Play schemes. We apply our proximal gradient algorithm to various ill-posed inverse problems, e.g. deblurring, super-resolution and inpainting. For all these applications, numerical results empirically confirm the convergence results. Experiments also show that this new algorithm reaches state-of-the-art performance, both quantitatively and qualitatively.
Key facts. Cited by 107 papers in the map (data through 7 Oct 2026). Builds on 45 of its 74 references that are in the map. First posted on arXiv 7 Oct 2021.
Builds on
45 of 74 references.
References · 45
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
- 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 244
- 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
- 2015Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restorationcited by 194
- 2017Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problemscited by 107
- 2018Adversarial Regularizers in Inverse Problemscited by 102
33 more
- 2018Regularization by Denoising: Clarifications and New Interpretationscited by 102
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 96
- 2015Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolationcited by 78
- 2020Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imagingcited by 78
- 2020Solving Linear Inverse Problems Using the Prior Implicit in a Denoisercited by 78
- 2019Plug and play methods for magnetic resonance imaging (long version)cited by 75
- 2018An Online Plug-and-Play Algorithm for Regularized Image Reconstructioncited by 70
- 2019RARE: Image Reconstruction using Deep Priors Learned without Ground Truthcited by 64
- 2020Learning Maximally Monotone Operators for Image Recoverycited by 62
- 2017Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibriumcited by 58
- 2020Regularization by Denoising via Fixed-Point Projection (RED-PRO)cited by 55
- 2020Scalable Plug-and-Play ADMM with Convergence Guaranteescited by 49
- 2018prDeep: Robust Phase Retrieval with a Flexible Deep Networkcited by 46
- 2019Neural Empirical Bayescited by 46
- 2020Provable Convergence of Plug-and-Play Priors with MMSE denoiserscited by 39
- 2020Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problemscited by 38
- 2020Convolutional Proximal Neural Networks and Plug-and-Play Algorithmscited by 36
- 2017Deep Mean-Shift Priors for Image Restorationcited by 34
- 2019Block Coordinate Regularization by Denoisingcited by 33
- 2014iPiano: Inertial Proximal Algorithm for Non-Convex Optimizationcited by 30
- 2021Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Priorcited by 24
- 2021Recovery Analysis for Plug-and-Play Priors using the Restricted Eigenvalue Conditioncited by 22
- 2021Fixed-Point and Objective Convergence of Plug-and-Play Algorithmscited by 19
- 2019On approximating nabla f with neural networkscited by 18
- 2021Learning local regularization for variational image restorationcited by 16
- 2018Performance Analysis of Plug-and-Play ADMM: A Graph Signal Processing Perspectivecited by 13
- 2020Plug-and-play ISTA converges with kernel denoiserscited by 12
- 2021On Plug-and-Play Regularization using Linear Denoiserscited by 9
- 2017Image Restoration using Autoencoding Priorscited by 8
- 2020Learning Generative Models using Denoising Density Estimatorscited by 8
- 2020Async-RED: A Provably Convergent Asynchronous Block Parallel Stochastic Method using Deep Denoising Priorscited by 8
- 2017Backtracking strategies for accelerated descent methods with smooth composite objectivescited by 7
- 2019On the Proof of Fixed-Point Convergence for Plug-and-Play ADMMcited by 6
Built on by
Citing papers per year: 2022: 13; 2023: 23; 2024: 19; 2025: 30; 2026: 22.
107 papers.
Sort:
By area:
- 2024PnP-Flow: Plug-and-Play Image Restoration with Flow Matchingcited by 92
- 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 79
- 2022Neural Conservation Laws: A Divergence-Free Perspectivecited by 67
- 2022Learned reconstruction methods with convergence guaranteescited by 46
- 2022A Neural-Network-Based Convex Regularizer for Inverse Problemscited by 40
- 2023Fast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolutioncited by 36
- 2023Learning Weakly Convex Regularizers for Convergent Image-Reconstruction Algorithmscited by 30
- 2023Equivariant plug-and-play image reconstructioncited by 26
- 2022Automatic differentiation of nonsmooth iterative algorithmscited by 25
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 24
- 2022Improving Lipschitz-Constrained Neural Networks by Learning Activation Functionscited by 23
- 2025Flower: A Flow-Matching Solver for Inverse Problemscited by 23
38 more
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularizationcited by 22
- 2022Online Deep Equilibrium Learning for Regularization by Denoisingcited by 22
- 2024Plug-and-Play image restoration with Stochastic deNOising REgularizationcited by 17
- 2025Learning normalized image densities via dual score matchingcited by 17
- 2023Provably Convergent Plug-and-Play Quasi-Newton Methodscited by 15
- 2022On Maximum-a-Posteriori estimation with Plug & Play priors and stochastic gradient descentcited by 14
- 2023Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse Problemscited by 14
- 2023Convergent regularization in inverse problems and linear plug-and-play denoiserscited by 13
- 2023A relaxed proximal gradient descent algorithm for convergent plug-and-play with proximal denoisercited by 12
- 2025NTIRE 2025 Challenge on Image Super-Resolution (x4): Methods and Resultscited by 12
- 2025Learning Regularization Functionals for Inverse Problems: A Comparative Studycited by 12
- 2023Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysiscited by 10
- 2022Deep Model-Based Architectures for Inverse Problems under Mismatched Priorscited by 8
- 2023Block Coordinate Plug-and-Play Methods for Blind Inverse Problemscited by 8
- 2025Proximal Algorithm Unrolling: Flexible and Efficient Reconstruction Networks for Single-Pixel Imagingcited by 8
- 2022PnP-ReG: Learned Regularizing Gradient for Plug-and-Play Gradient Descentcited by 7
- 2023Unfolded proximal neural networks for robust image Gaussian denoisingcited by 7
- 2025Deep Equilibrium models for Poisson Imaging Inverse problems via Mirror Descentcited by 7
- 2023Restoration based Generative Modelscited by 6
- 2023Inverse problem regularization with hierarchical variational autoencoderscited by 6
- 2024Learning pseudo-contractive denoisers for inverse problemscited by 6
- 2025DEALing with Image Reconstruction: Deep Attentive Least Squarescited by 6
- 2023Convergent plug-and-play with proximal denoiser and unconstrained regularization parametercited by 5
- 2024Stability of Data-Dependent Ridge-Regularization for Inverse Problemscited by 5
- 2024Plug-and-Play Priors as a Score-Based Methodcited by 5
- 2025MAP Estimation with Denoisers: Convergence Rates and Guaranteescited by 5
- 2022Robustness of Deep Equilibrium Architectures to Changes in the Measurement Modelcited by 4
- 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problemscited by 4
- 2023Provably Convergent Data-Driven Convex-Nonconvex Regularizationcited by 4
- 2023Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imagingcited by 4
- 2023Variational Bayes image restoration with compressive autoencoderscited by 4
- 2025Learning Cocoercive Conservative Denoisers via Helmholtz Decomposition for Poisson Inverse Problemscited by 4
- 2024Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimationcited by 3
- 2024Plug-and-Play Half-Quadratic Splitting for Ptychographycited by 3
- 2025A Recovery Theory for Diffusion Priors: Deterministic Analysis of the Implicit Prior Algorithmcited by 3
- 2025Plug-and-Play Image Restoration with Flow Matching: A Continuous Viewpointcited by 3
- 2023RED-PSM: Regularization by Denoising of Factorized Low Rank Models for Dynamic Imagingcited by 2
- 2024Learning truly monotone operators with applications to nonlinear inverse problemscited by 2
50 most cited of 107 All 107 (JSON)
- 2026Principled MAP estimation for inverse problems: bridging the gap between convergence and performance29 Sep 2026
- 2026SNaP: One-Step Posterior Sampling for Noisy Inverse Problems28 Sep 2026
- 2026Plug-and-Play Methods Provably Converge Even with Improperly Trained Denoisers: Convergence by Architectural Design27 Sep 2026
- 2026Convergent Plug-and-Play Image Restoration with Annealed Noise Levels26 Sep 2026
- 2026Fast and Faithful: Principled Conditional Flow Matching for Inverse Problems11 Sep 2026
- 2026Frozen CLIP Priors for Robust Self-Supervised Poisson Inverse Problems20 Aug 2026
- 2026A neural operator view on U-Nets for inverse imaging problems6 Aug 2026
- 2026Stabilizing Deep Reconstruction Operators with Contractive Anchoring25 Jul 2026
- 2026Domain Adaptation of Mismatched Proximal Denoiser for Plug-and-Play Image Reconstruction16 Jul 2026
- 2026Multilevel Stochastic Plug-and-Play for Sparse-View CT Reconstruction23 Jun 2026
- 2026SP3: Spherical Priors for Plug-and-Play Restoration15 Jun 2026
- 2026Gradient Step Plug-and-Play Model for Dental Cone-Beam CT Reconstruction27 May 2026
38 more
- 2026A Stability Benchmark of Generative Regularizers for Inverse Problems11 May 2026
- 2026FlowADMM: Plug-and-play ADMM with Flow-based Renoise-Denoise Priors9 May 2026
- 2026P-Flow: Proxy-gradient Flows for Linear Inverse Problems8 May 2026
- 2026Weakly Convex Ridge Regularization for 3D Non-Cartesian MRI Reconstruction28 Mar 2026
- 2026Provably Contractive and High-Quality Denoisers for Convergent Restoration27 Mar 2026
- 2026A convergent Plug-and-Play Majorization-Minimization algorithm for Poisson inverse problems25 Mar 2026
- 2026Taming Score-Based Denoisers in ADMM: A Convergent Plug-and-Play Framework10 Mar 2026
- 2026Deep unfolding of MCMC kernels: scalable, modular & explainable GANs for high-dimensional posterior sampling24 Feb 2026
- 2026A New Convergence Analysis of Plug-and-Play Proximal Gradient Descent Under Prior Mismatch14 Jan 2026
- 2026Annealed Langevin Posterior Sampling (ALPS): A Rapid Algorithm for Image Restoration with Multiscale Energy Models5 Jan 2026
- 2025Plug-and-Play Image Restoration with Flow Matching: A Continuous Viewpoint3 Dec 2025
- 2025Equivariant Deep Equilibrium Models for Imaging Inverse Problems24 Nov 2025
- 2025Bregman geometry-aware split Gibbs sampling for Bayesian Poisson inverse problems15 Nov 2025
- 2025Bayesian model selection and misspecification testing in imaging inverse problems only from noisy and partial measurements31 Oct 2025
- 2025Nonasymptotic Convergence Rates for Plug-and-Play Methods With MMSE Denoisers31 Oct 2025
- 2025Beyond sparse denoising in frames: minimax estimation with a scattering transform22 Oct 2025
- 2025Learning Regularization Functionals for Inverse Problems: A Comparative Study2 Oct 2025
- 2025LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restoration1 Oct 2025
- 2025Flower: A Flow-Matching Solver for Inverse Problems30 Sep 2025
- 2025A Recovery Theory for Diffusion Priors: Deterministic Analysis of the Implicit Prior Algorithm24 Sep 2025
- 2025Progressive Flow-inspired Unfolding for Spectral Compressive Imaging15 Sep 2025
- 2025From the Gradient-Step Denoiser to the Proximal Denoiser and their associated convergent Plug-and-Play algorithms11 Sep 2025
- 2025Solving Imaging Inverse Problems Using Plug-and-Play Denoisers: Regularization and Optimization Perspectives3 Sep 2025
- 2025Neural Stochastic Differential Equations on Compact State Spaces: Theory, Methods, and Application to Suicide Risk Modeling23 Aug 2025
- 2025Multivariate Fields of Experts for Convergent Image Reconstruction8 Aug 2025
- 2025A Morse-Bott Framework for Blind Inverse Problems: Local Recovery Guarantees and the Failure of the MAP4 Aug 2025
- 2025MAP Estimation with Denoisers: Convergence Rates and Guarantees21 Jul 2025
- 2025Deep Equilibrium models for Poisson Imaging Inverse problems via Mirror Descent15 Jul 2025
- 2025Learning normalized image densities via dual score matching5 Jun 2025
- 2025Proximal Algorithm Unrolling: Flexible and Efficient Reconstruction Networks for Single-Pixel Imaging29 May 2025
- 2025Plug-and-Play Posterior Sampling for Blind Inverse Problems28 May 2025
- 2025Learning Cocoercive Conservative Denoisers via Helmholtz Decomposition for Poisson Inverse Problems13 May 2025
- 2025NTIRE 2025 Challenge on Image Super-Resolution (x4): Methods and Results20 Apr 2025
- 2025PG-DPIR: An efficient plug-and-play method for high-count Poisson-Gaussian inverse problems14 Apr 2025
- 2025Deep End-to-End Posterior ENergy (DEEPEN) for image recovery21 Mar 2025
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problems20 Mar 2025
- 2025Reconstruct Anything Model: a lightweight general model for computational imaging11 Mar 2025
- 2025RestoreGrad: Signal Restoration Using Conditional Denoising Diffusion Models with Jointly Learned Prior19 Feb 2025
50 newest of 107 All 107 (JSON)
- 2024PnP-Flow: Plug-and-Play Image Restoration with Flow Matchingcited by 92
- 2023Fast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolutioncited by 36
- 2025Flower: A Flow-Matching Solver for Inverse Problemscited by 23
- 2023Restoration based Generative Modelscited by 6
- 2025A Recovery Theory for Diffusion Priors: Deterministic Analysis of the Implicit Prior Algorithmcited by 3
- 2025Plug-and-Play Image Restoration with Flow Matching: A Continuous Viewpointcited by 3
- 2025Plug-and-Play Posterior Sampling for Blind Inverse Problemscited by 2
- 2025LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restorationcited by 2
- 2026Taming Score-Based Denoisers in ADMM: A Convergent Plug-and-Play Frameworkcited by 1
- 2025RestoreGrad: Signal Restoration Using Conditional Denoising Diffusion Models with Jointly Learned Priorcited by 0
- 2025Deep End-to-End Posterior ENergy (DEEPEN) for image recoverycited by 0
- 2026Annealed Langevin Posterior Sampling (ALPS): A Rapid Algorithm for Image Restoration with Multiscale Energy Modelscited by 0
12 most cited of 15 All 15 (JSON)
- 2026SNaP: One-Step Posterior Sampling for Noisy Inverse Problems28 Sep 2026
- 2026Fast and Faithful: Principled Conditional Flow Matching for Inverse Problems11 Sep 2026
- 2026P-Flow: Proxy-gradient Flows for Linear Inverse Problems8 May 2026
- 2026Taming Score-Based Denoisers in ADMM: A Convergent Plug-and-Play Framework10 Mar 2026
- 2026Annealed Langevin Posterior Sampling (ALPS): A Rapid Algorithm for Image Restoration with Multiscale Energy Models5 Jan 2026
- 2025Plug-and-Play Image Restoration with Flow Matching: A Continuous Viewpoint3 Dec 2025
- 2025LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restoration1 Oct 2025
- 2025Flower: A Flow-Matching Solver for Inverse Problems30 Sep 2025
- 2025A Recovery Theory for Diffusion Priors: Deterministic Analysis of the Implicit Prior Algorithm24 Sep 2025
- 2025Plug-and-Play Posterior Sampling for Blind Inverse Problems28 May 2025
- 2025Deep End-to-End Posterior ENergy (DEEPEN) for image recovery21 Mar 2025
- 2025RestoreGrad: Signal Restoration Using Conditional Denoising Diffusion Models with Jointly Learned Prior19 Feb 2025
12 newest of 15 All 15 (JSON)
- 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 79
- 2022Neural Conservation Laws: A Divergence-Free Perspectivecited by 67
- 2022Learned reconstruction methods with convergence guaranteescited by 46
- 2022A Neural-Network-Based Convex Regularizer for Inverse Problemscited by 40
- 2023Learning Weakly Convex Regularizers for Convergent Image-Reconstruction Algorithmscited by 30
- 2023Equivariant plug-and-play image reconstructioncited by 26
- 2022Automatic differentiation of nonsmooth iterative algorithmscited by 25
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 24
- 2022Improving Lipschitz-Constrained Neural Networks by Learning Activation Functionscited by 23
- 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularizationcited by 22
- 2022Online Deep Equilibrium Learning for Regularization by Denoisingcited by 22
- 2024Plug-and-Play image restoration with Stochastic deNOising REgularizationcited by 17
12 most cited of 92 All 92 (JSON)
- 2026Principled MAP estimation for inverse problems: bridging the gap between convergence and performance29 Sep 2026
- 2026Plug-and-Play Methods Provably Converge Even with Improperly Trained Denoisers: Convergence by Architectural Design27 Sep 2026
- 2026Convergent Plug-and-Play Image Restoration with Annealed Noise Levels26 Sep 2026
- 2026Frozen CLIP Priors for Robust Self-Supervised Poisson Inverse Problems20 Aug 2026
- 2026A neural operator view on U-Nets for inverse imaging problems6 Aug 2026
- 2026Stabilizing Deep Reconstruction Operators with Contractive Anchoring25 Jul 2026
- 2026Domain Adaptation of Mismatched Proximal Denoiser for Plug-and-Play Image Reconstruction16 Jul 2026
- 2026Multilevel Stochastic Plug-and-Play for Sparse-View CT Reconstruction23 Jun 2026
- 2026SP3: Spherical Priors for Plug-and-Play Restoration15 Jun 2026
- 2026Gradient Step Plug-and-Play Model for Dental Cone-Beam CT Reconstruction27 May 2026
- 2026A Stability Benchmark of Generative Regularizers for Inverse Problems11 May 2026
- 2026FlowADMM: Plug-and-play ADMM with Flow-based Renoise-Denoise Priors9 May 2026
12 newest of 92 All 92 (JSON)