PnP-ReG: Learned Regularizing Gradient for Plug-and-Play Gradient Descent
Not on the map. Why?
Abstract (arXiv)
The Plug-and-Play (PnP) framework makes it possible to integrate advanced image denoising priors into optimization algorithms, to efficiently solve a variety of image restoration tasks generally formulated as Maximum A Posteriori (MAP) estimation problems. The Plug-and-Play alternating direction method of multipliers (ADMM) and the Regularization by Denoising (RED) algorithms are two examples of such methods that made a breakthrough in image restoration. However, while the former method only applies to proximal algorithms, it has recently been shown that there exists no regularization that explains the RED algorithm when the denoisers lack Jacobian symmetry, which happen to be the case of most practical denoisers. To the best of our knowledge, there exists no method for training a network that directly represents the gradient of a regularizer, which can be directly used in Plug-and-Play gradient-based algorithms. We show that it is possible to train a network directly modeling the gradient of a MAP regularizer while jointly training the corresponding MAP denoiser. We use this network in gradient-based optimization methods and obtain better results comparing to other generic Plug-and-Play approaches. We also show that the regularizer can be used as a pre-trained network for unrolled gradient descent. Lastly, we show that the resulting denoiser allows for a better convergence of the Plug-and-Play ADMM.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 37 of its 67 references that are in the map. First posted on arXiv 29 Apr 2022.
Builds on
37 of 67 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 470
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 408
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 307
- 2020Deep Unfolding Network for Image Super-Resolutioncited by 254
25 more
- 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
- 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 246
- 2015Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restorationcited by 195
- 2017Solving ill-posed inverse problems using iterative deep neural networkscited by 145
- 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 108
- 2018Regularization by Denoising: Clarifications and New Interpretationscited by 103
- 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 97
- 2019Robust and interpretable blind image denoising via bias-free convolutional neural networkscited by 90
- 2020Solving Linear Inverse Problems Using the Prior Implicit in a Denoisercited by 79
- 2015Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolationcited by 78
- 2017One Network to Solve Them All --- Solving Linear Inverse Problems using Deep Projection Modelscited by 67
- 2018Image Restoration using Total Variation Regularized Deep Image Priorcited by 65
- 2020Total Deep Variation for Linear Inverse Problemscited by 53
- 2018Neural Proximal Gradient Descent for Compressive Imagingcited by 46
- 2017Unrolled Optimization with Deep Priorscited by 40
- 2020Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problemscited by 38
- 2021DWDN: Deep Wiener Deconvolution Network for Non-Blind Image Deblurringcited by 36
- 2018Deep Energy Estimator Networkscited by 34
- 2015Weighted Schatten p-Norm Minimization for Image Denoising and Background Subtractioncited by 29
- 2017Learning to Invert: Signal Recovery via Deep Convolutional Networkscited by 22
- 2020End-to-end Interpretable Learning of Non-blind Image Deblurringcited by 16
- 2020Combining Weighted Total Variation and Deep Image Prior for natural and medical image restoration via ADMMcited by 13
- 2020Accurate and Lightweight Image Super-Resolution with Model-Guided Deep Unfolding Networkcited by 12
- 2021Preconditioned Plug-and-Play ADMM with Locally Adjustable Denoiser for Image Restorationcited by 7
- 2018Non-blind Image Restoration Based on Convolutional Neural Networkcited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 2; 2025: 1; 2026: 1.
7 papers.
- 2022A Neural-Network-Based Convex Regularizer for Inverse Problemscited by 41
- 2024Plug-and-Play image restoration with Stochastic deNOising REgularizationcited by 17
- 2025Learning Regularization Functionals for Inverse Problems: A Comparative Studycited by 15
- 2023RED-PSM: Regularization by Denoising of Factorized Low Rank Models for Dynamic Imagingcited by 2
- 2023Convergence analysis of equilibrium methods for inverse problemscited by 2
- 2024Gradient Networkscited by 0
- 2026Domain Adaptation of Mismatched Proximal Denoiser for Plug-and-Play Image Reconstructioncited by 0
- 2026Domain Adaptation of Mismatched Proximal Denoiser for Plug-and-Play Image Reconstruction16 Jul 2026
- 2025Learning Regularization Functionals for Inverse Problems: A Comparative Study2 Oct 2025
- 2024Gradient Networks10 Apr 2024
- 2024Plug-and-Play image restoration with Stochastic deNOising REgularization1 Feb 2024
- 2023Convergence analysis of equilibrium methods for inverse problems2 Jun 2023
- 2023RED-PSM: Regularization by Denoising of Factorized Low Rank Models for Dynamic Imaging7 Apr 2023
- 2022A Neural-Network-Based Convex Regularizer for Inverse Problems22 Nov 2022