Provably Convergent Plug-and-Play Quasi-Newton Methods
Not on the map. Why?
Abstract (arXiv)
Plug-and-Play (PnP) methods are a class of efficient iterative methods that aim to combine data fidelity terms and deep denoisers using classical optimization algorithms, such as ISTA or ADMM, with applications in inverse problems and imaging. Provable PnP methods are a subclass of PnP methods with convergence guarantees, such as fixed point convergence or convergence to critical points of some energy function. Many existing provable PnP methods impose heavy restrictions on the denoiser or fidelity function, such as non-expansiveness or strict convexity, respectively. In this work, we propose a novel algorithmic approach incorporating quasi-Newton steps into a provable PnP framework based on proximal denoisers, resulting in greatly accelerated convergence while retaining light assumptions on the denoiser. By characterizing the denoiser as the proximal operator of a weakly convex function, we show that the fixed points of the proposed quasi-Newton PnP algorithm are critical points of a weakly convex function. Numerical experiments on image deblurring and super-resolution demonstrate 2--8x faster convergence as compared to other provable PnP methods with similar reconstruction quality.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 42 of its 96 references that are in the map. First posted on arXiv 9 Mar 2023.
Builds on
42 of 96 references.
References · 42
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 470
- 2016Input Convex Neural Networkscited by 414
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 408
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
- 2019Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networkscited by 293
- 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 246
- 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 198
- 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 108
- 2018Adversarial Regularizers in Inverse Problemscited by 103
- 2018Regularization by Denoising: Clarifications and New Interpretationscited by 103
30 more
- 2022Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imagingcited by 96
- 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 80
- 2015Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolationcited by 78
- 2018An Online Plug-and-Play Algorithm for Regularized Image Reconstructioncited by 70
- 2014A Stochastic Quasi-Newton Method for Large-Scale Optimizationcited by 69
- 2020Learning Maximally Monotone Operators for Image Recoverycited by 62
- 2017Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibriumcited by 58
- 2020Regularization by Denoising via Fixed-Point Projection (RED-PRO)cited by 55
- 2020Learned convex regularizers for inverse problemscited by 55
- 2020Scalable Plug-and-Play ADMM with Convergence Guaranteescited by 50
- 2022Learned reconstruction methods with convergence guaranteescited by 46
- 2016Stochastic Quasi-Newton Methods for Nonconvex Stochastic Optimizationcited by 37
- 2020Convolutional Proximal Neural Networks and Plug-and-Play Algorithmscited by 36
- 2017Deep Mean-Shift Priors for Image Restorationcited by 34
- 2018A characterization of proximity operatorscited by 32
- 2020Greedy Quasi-Newton Methods with Explicit Superlinear Convergencecited by 21
- 2018A Survey on Nonconvex Regularization Based Sparse and Low-Rank Recovery in Signal Processing, Statistics, and Machine Learningcited by 20
- 2014Global convergence of splitting methods for nonconvex composite optimizationcited by 19
- 2021Fixed-Point and Objective Convergence of Plug-and-Play Algorithmscited by 19
- 2014Global Convergence of Online Limited Memory BFGScited by 18
- 2020Non-asymptotic Superlinear Convergence of Standard Quasi-Newton Methodscited by 16
- 2022Approximation of Lipschitz Functions using Deep Spline Neural Networkscited by 15
- 2020Rates of superlinear convergence for classical quasi-Newton methodscited by 13
- 2023A relaxed proximal gradient descent algorithm for convergent plug-and-play with proximal denoisercited by 12
- 2016Forward-backward quasi-Newton methods for nonsmooth optimization problemscited by 9
- 2020Async-RED: A Provably Convergent Asynchronous Block Parallel Stochastic Method using Deep Denoising Priorscited by 8
- 2022Sharpened Quasi-Newton Methods: Faster Superlinear Rate and Larger Local Convergence Neighborhoodcited by 7
- 2017Learning Convex Regularizers for Optimal Bayesian Denoisingcited by 5
- 2017Adaptive FISTA for Non-convex Optimizationcited by 2
- 2022Accelerating Plug-and-Play Image Reconstruction via Multi-Stage Sketched Gradientscited by 2
Built on by
Citing papers per year: 2023: 3; 2024: 4; 2025: 6; 2026: 2.
15 papers.
Sort:
By area:
- 2024PnP-Flow: Plug-and-Play Image Restoration with Flow Matchingcited by 97
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 25
- 2025Good Things Come in Pairs: Paired Autoencoders for Inverse Problemscited by 5
- 2023Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imagingcited by 4
- 2025Plug-and-Play Image Restoration with Flow Matching: A Continuous Viewpointcited by 3
- 2023Convergence analysis of equilibrium methods for inverse problemscited by 2
- 2024LoFi: Neural Local Fields for Scalable Image Reconstructioncited by 2
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problemscited by 2
- 2025LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restorationcited by 2
- 2025Solving Imaging Inverse Problems Using Plug-and-Play Denoisers: Regularization and Optimization Perspectivescited by 1
- 2024HPPP: Halpern-type Preconditioned Proximal Point Algorithms and Applications to Image Restorationcited by 0
- 2024Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problemscited by 0
3 more
- 2025Fast Equivariant Imaging: Accelerating Unsupervised Learning and Model Adaptation via Inexact Splittingcited by 0
- 2026A New Convergence Analysis of Plug-and-Play Proximal Gradient Descent Under Prior Mismatchcited by 0
- 2026Stabilizing Deep Reconstruction Operators with Contractive Anchoringcited by 0
- 2026Stabilizing Deep Reconstruction Operators with Contractive Anchoring25 Jul 2026
- 2026A New Convergence Analysis of Plug-and-Play Proximal Gradient Descent Under Prior Mismatch14 Jan 2026
- 2025Plug-and-Play Image Restoration with Flow Matching: A Continuous Viewpoint3 Dec 2025
- 2025LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restoration1 Oct 2025
- 2025Solving Imaging Inverse Problems Using Plug-and-Play Denoisers: Regularization and Optimization Perspectives3 Sep 2025
- 2025Fast Equivariant Imaging: Accelerating Unsupervised Learning and Model Adaptation via Inexact Splitting9 Jul 2025
- 2025Good Things Come in Pairs: Paired Autoencoders for Inverse Problems10 May 2025
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problems20 Mar 2025
- 2024Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problems8 Nov 2024
- 2024LoFi: Neural Local Fields for Scalable Image Reconstruction7 Nov 2024
- 2024PnP-Flow: Plug-and-Play Image Restoration with Flow Matching3 Oct 2024
- 2024HPPP: Halpern-type Preconditioned Proximal Point Algorithms and Applications to Image Restoration18 Jul 2024
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problemscited by 25
- 2025Good Things Come in Pairs: Paired Autoencoders for Inverse Problemscited by 5
- 2023Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imagingcited by 4
- 2023Convergence analysis of equilibrium methods for inverse problemscited by 2
- 2024LoFi: Neural Local Fields for Scalable Image Reconstructioncited by 2
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problemscited by 2
- 2025Solving Imaging Inverse Problems Using Plug-and-Play Denoisers: Regularization and Optimization Perspectivescited by 1
- 2024HPPP: Halpern-type Preconditioned Proximal Point Algorithms and Applications to Image Restorationcited by 0
- 2024Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problemscited by 0
- 2025Fast Equivariant Imaging: Accelerating Unsupervised Learning and Model Adaptation via Inexact Splittingcited by 0
- 2026A New Convergence Analysis of Plug-and-Play Proximal Gradient Descent Under Prior Mismatchcited by 0
- 2026Stabilizing Deep Reconstruction Operators with Contractive Anchoringcited by 0
- 2026Stabilizing Deep Reconstruction Operators with Contractive Anchoring25 Jul 2026
- 2026A New Convergence Analysis of Plug-and-Play Proximal Gradient Descent Under Prior Mismatch14 Jan 2026
- 2025Solving Imaging Inverse Problems Using Plug-and-Play Denoisers: Regularization and Optimization Perspectives3 Sep 2025
- 2025Fast Equivariant Imaging: Accelerating Unsupervised Learning and Model Adaptation via Inexact Splitting9 Jul 2025
- 2025Good Things Come in Pairs: Paired Autoencoders for Inverse Problems10 May 2025
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problems20 Mar 2025
- 2024Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problems8 Nov 2024
- 2024LoFi: Neural Local Fields for Scalable Image Reconstruction7 Nov 2024
- 2024HPPP: Halpern-type Preconditioned Proximal Point Algorithms and Applications to Image Restoration18 Jul 2024
- 2023Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imaging15 Nov 2023
- 2023What's in a Prior? Learned Proximal Networks for Inverse Problems22 Oct 2023
- 2023Convergence analysis of equilibrium methods for inverse problems2 Jun 2023