mlsanityData to 7 Oct 2026

Gradient Step Denoiser for convergent Plug-and-Play

arXiv 2110.03220 ↗First posted 7 Oct 2021cs.CV eess.IV math.OCcited by 107

Not on the map. Why?

Abstract (arXiv)

Plug-and-Play methods constitute a class of iterative algorithms for imaging problems where regularization is performed by an off-the-shelf denoiser. Although Plug-and-Play methods can lead to tremendous visual performance for various image problems, the few existing convergence guarantees are based on unrealistic (or suboptimal) hypotheses on the denoiser, or limited to strongly convex data terms. In this work, we propose a new type of Plug-and-Play methods, based on half-quadratic splitting, for which the denoiser is realized as a gradient descent step on a functional parameterized by a deep neural network. Exploiting convergence results for proximal gradient descent algorithms in the non-convex setting, we show that the proposed Plug-and-Play algorithm is a convergent iterative scheme that targets stationary points of an explicit global functional. Besides, experiments show that it is possible to learn such a deep denoiser while not compromising the performance in comparison to other state-of-the-art deep denoisers used in Plug-and-Play schemes. We apply our proximal gradient algorithm to various ill-posed inverse problems, e.g. deblurring, super-resolution and inpainting. For all these applications, numerical results empirically confirm the convergence results. Experiments also show that this new algorithm reaches state-of-the-art performance, both quantitatively and qualitatively.

Key facts. Cited by 107 papers in the map (data through 7 Oct 2026). Builds on 45 of its 74 references that are in the map. First posted on arXiv 7 Oct 2021.

Builds on

45 of 74 references.

References · 45

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  3. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  4. 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
  5. 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
  6. 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
  7. 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
  8. 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 244
  9. 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
  10. 2015Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restorationcited by 194
  11. 2017Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problemscited by 107
  12. 2018Adversarial Regularizers in Inverse Problemscited by 102
33 more
  1. 2018Regularization by Denoising: Clarifications and New Interpretationscited by 102
  2. 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 96
  3. 2015Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolationcited by 78
  4. 2020Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imagingcited by 78
  5. 2020Solving Linear Inverse Problems Using the Prior Implicit in a Denoisercited by 78
  6. 2019Plug and play methods for magnetic resonance imaging (long version)cited by 75
  7. 2018An Online Plug-and-Play Algorithm for Regularized Image Reconstructioncited by 70
  8. 2019RARE: Image Reconstruction using Deep Priors Learned without Ground Truthcited by 64
  9. 2020Learning Maximally Monotone Operators for Image Recoverycited by 62
  10. 2017Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibriumcited by 58
  11. 2020Regularization by Denoising via Fixed-Point Projection (RED-PRO)cited by 55
  12. 2020Scalable Plug-and-Play ADMM with Convergence Guaranteescited by 49
  13. 2018prDeep: Robust Phase Retrieval with a Flexible Deep Networkcited by 46
  14. 2019Neural Empirical Bayescited by 46
  15. 2020Provable Convergence of Plug-and-Play Priors with MMSE denoiserscited by 39
  16. 2020Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problemscited by 38
  17. 2020Convolutional Proximal Neural Networks and Plug-and-Play Algorithmscited by 36
  18. 2017Deep Mean-Shift Priors for Image Restorationcited by 34
  19. 2019Block Coordinate Regularization by Denoisingcited by 33
  20. 2014iPiano: Inertial Proximal Algorithm for Non-Convex Optimizationcited by 30
  21. 2021Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Priorcited by 24
  22. 2021Recovery Analysis for Plug-and-Play Priors using the Restricted Eigenvalue Conditioncited by 22
  23. 2021Fixed-Point and Objective Convergence of Plug-and-Play Algorithmscited by 19
  24. 2019On approximating nabla f with neural networkscited by 18
  25. 2021Learning local regularization for variational image restorationcited by 16
  26. 2018Performance Analysis of Plug-and-Play ADMM: A Graph Signal Processing Perspectivecited by 13
  27. 2020Plug-and-play ISTA converges with kernel denoiserscited by 12
  28. 2021On Plug-and-Play Regularization using Linear Denoiserscited by 9
  29. 2017Image Restoration using Autoencoding Priorscited by 8
  30. 2020Learning Generative Models using Denoising Density Estimatorscited by 8
  31. 2020Async-RED: A Provably Convergent Asynchronous Block Parallel Stochastic Method using Deep Denoising Priorscited by 8
  32. 2017Backtracking strategies for accelerated descent methods with smooth composite objectivescited by 7
  33. 2019On the Proof of Fixed-Point Convergence for Plug-and-Play ADMMcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 13; 2023: 23; 2024: 19; 2025: 30; 2026: 22.

107 papers.

Sort:

By area:

  1. 2024PnP-Flow: Plug-and-Play Image Restoration with Flow Matchingcited by 92
  2. 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 79
  3. 2022Neural Conservation Laws: A Divergence-Free Perspectivecited by 67
  4. 2022Learned reconstruction methods with convergence guaranteescited by 46
  5. 2022A Neural-Network-Based Convex Regularizer for Inverse Problemscited by 40
  6. 2023Fast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolutioncited by 36
  7. 2023Learning Weakly Convex Regularizers for Convergent Image-Reconstruction Algorithmscited by 30
  8. 2023Equivariant plug-and-play image reconstructioncited by 26
  9. 2022Automatic differentiation of nonsmooth iterative algorithmscited by 25
  10. 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 24
  11. 2022Improving Lipschitz-Constrained Neural Networks by Learning Activation Functionscited by 23
  12. 2025Flower: A Flow-Matching Solver for Inverse Problemscited by 23
38 more
  1. 2022PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularizationcited by 22
  2. 2022Online Deep Equilibrium Learning for Regularization by Denoisingcited by 22
  3. 2024Plug-and-Play image restoration with Stochastic deNOising REgularizationcited by 17
  4. 2025Learning normalized image densities via dual score matchingcited by 17
  5. 2023Provably Convergent Plug-and-Play Quasi-Newton Methodscited by 15
  6. 2022On Maximum-a-Posteriori estimation with Plug & Play priors and stochastic gradient descentcited by 14
  7. 2023Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse Problemscited by 14
  8. 2023Convergent regularization in inverse problems and linear plug-and-play denoiserscited by 13
  9. 2023A relaxed proximal gradient descent algorithm for convergent plug-and-play with proximal denoisercited by 12
  10. 2025NTIRE 2025 Challenge on Image Super-Resolution (x4): Methods and Resultscited by 12
  11. 2025Learning Regularization Functionals for Inverse Problems: A Comparative Studycited by 12
  12. 2023Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysiscited by 10
  13. 2022Deep Model-Based Architectures for Inverse Problems under Mismatched Priorscited by 8
  14. 2023Block Coordinate Plug-and-Play Methods for Blind Inverse Problemscited by 8
  15. 2025Proximal Algorithm Unrolling: Flexible and Efficient Reconstruction Networks for Single-Pixel Imagingcited by 8
  16. 2022PnP-ReG: Learned Regularizing Gradient for Plug-and-Play Gradient Descentcited by 7
  17. 2023Unfolded proximal neural networks for robust image Gaussian denoisingcited by 7
  18. 2025Deep Equilibrium models for Poisson Imaging Inverse problems via Mirror Descentcited by 7
  19. 2023Restoration based Generative Modelscited by 6
  20. 2023Inverse problem regularization with hierarchical variational autoencoderscited by 6
  21. 2024Learning pseudo-contractive denoisers for inverse problemscited by 6
  22. 2025DEALing with Image Reconstruction: Deep Attentive Least Squarescited by 6
  23. 2023Convergent plug-and-play with proximal denoiser and unconstrained regularization parametercited by 5
  24. 2024Stability of Data-Dependent Ridge-Regularization for Inverse Problemscited by 5
  25. 2024Plug-and-Play Priors as a Score-Based Methodcited by 5
  26. 2025MAP Estimation with Denoisers: Convergence Rates and Guaranteescited by 5
  27. 2022Robustness of Deep Equilibrium Architectures to Changes in the Measurement Modelcited by 4
  28. 2023NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging Inverse Problemscited by 4
  29. 2023Provably Convergent Data-Driven Convex-Nonconvex Regularizationcited by 4
  30. 2023Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imagingcited by 4
  31. 2023Variational Bayes image restoration with compressive autoencoderscited by 4
  32. 2025Learning Cocoercive Conservative Denoisers via Helmholtz Decomposition for Poisson Inverse Problemscited by 4
  33. 2024Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimationcited by 3
  34. 2024Plug-and-Play Half-Quadratic Splitting for Ptychographycited by 3
  35. 2025A Recovery Theory for Diffusion Priors: Deterministic Analysis of the Implicit Prior Algorithmcited by 3
  36. 2025Plug-and-Play Image Restoration with Flow Matching: A Continuous Viewpointcited by 3
  37. 2023RED-PSM: Regularization by Denoising of Factorized Low Rank Models for Dynamic Imagingcited by 2
  38. 2024Learning truly monotone operators with applications to nonlinear inverse problemscited by 2

50 most cited of 107 All 107 (JSON)