mlsanityData to 14 Oct 2026

Provably Convergent Plug-and-Play Quasi-Newton Methods

arXiv 2303.07271 ↗First posted 9 Mar 2023math.OC cs.CV cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

Plug-and-Play (PnP) methods are a class of efficient iterative methods that aim to combine data fidelity terms and deep denoisers using classical optimization algorithms, such as ISTA or ADMM, with applications in inverse problems and imaging. Provable PnP methods are a subclass of PnP methods with convergence guarantees, such as fixed point convergence or convergence to critical points of some energy function. Many existing provable PnP methods impose heavy restrictions on the denoiser or fidelity function, such as non-expansiveness or strict convexity, respectively. In this work, we propose a novel algorithmic approach incorporating quasi-Newton steps into a provable PnP framework based on proximal denoisers, resulting in greatly accelerated convergence while retaining light assumptions on the denoiser. By characterizing the denoiser as the proximal operator of a weakly convex function, we show that the fixed points of the proposed quasi-Newton PnP algorithm are critical points of a weakly convex function. Numerical experiments on image deblurring and super-resolution demonstrate 2--8x faster convergence as compared to other provable PnP methods with similar reconstruction quality.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 42 of its 96 references that are in the map. First posted on arXiv 9 Mar 2023.

Builds on

42 of 96 references.

References · 42

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  3. 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 470
  4. 2016Input Convex Neural Networkscited by 414
  5. 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 408
  6. 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
  7. 2019Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networkscited by 293
  8. 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 246
  9. 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 198
  10. 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 108
  11. 2018Adversarial Regularizers in Inverse Problemscited by 103
  12. 2018Regularization by Denoising: Clarifications and New Interpretationscited by 103
30 more
  1. 2022Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imagingcited by 96
  2. 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 80
  3. 2015Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolationcited by 78
  4. 2018An Online Plug-and-Play Algorithm for Regularized Image Reconstructioncited by 70
  5. 2014A Stochastic Quasi-Newton Method for Large-Scale Optimizationcited by 69
  6. 2020Learning Maximally Monotone Operators for Image Recoverycited by 62
  7. 2017Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibriumcited by 58
  8. 2020Regularization by Denoising via Fixed-Point Projection (RED-PRO)cited by 55
  9. 2020Learned convex regularizers for inverse problemscited by 55
  10. 2020Scalable Plug-and-Play ADMM with Convergence Guaranteescited by 50
  11. 2022Learned reconstruction methods with convergence guaranteescited by 46
  12. 2016Stochastic Quasi-Newton Methods for Nonconvex Stochastic Optimizationcited by 37
  13. 2020Convolutional Proximal Neural Networks and Plug-and-Play Algorithmscited by 36
  14. 2017Deep Mean-Shift Priors for Image Restorationcited by 34
  15. 2018A characterization of proximity operatorscited by 32
  16. 2020Greedy Quasi-Newton Methods with Explicit Superlinear Convergencecited by 21
  17. 2018A Survey on Nonconvex Regularization Based Sparse and Low-Rank Recovery in Signal Processing, Statistics, and Machine Learningcited by 20
  18. 2014Global convergence of splitting methods for nonconvex composite optimizationcited by 19
  19. 2021Fixed-Point and Objective Convergence of Plug-and-Play Algorithmscited by 19
  20. 2014Global Convergence of Online Limited Memory BFGScited by 18
  21. 2020Non-asymptotic Superlinear Convergence of Standard Quasi-Newton Methodscited by 16
  22. 2022Approximation of Lipschitz Functions using Deep Spline Neural Networkscited by 15
  23. 2020Rates of superlinear convergence for classical quasi-Newton methodscited by 13
  24. 2023A relaxed proximal gradient descent algorithm for convergent plug-and-play with proximal denoisercited by 12
  25. 2016Forward-backward quasi-Newton methods for nonsmooth optimization problemscited by 9
  26. 2020Async-RED: A Provably Convergent Asynchronous Block Parallel Stochastic Method using Deep Denoising Priorscited by 8
  27. 2022Sharpened Quasi-Newton Methods: Faster Superlinear Rate and Larger Local Convergence Neighborhoodcited by 7
  28. 2017Learning Convex Regularizers for Optimal Bayesian Denoisingcited by 5
  29. 2017Adaptive FISTA for Non-convex Optimizationcited by 2
  30. 2022Accelerating Plug-and-Play Image Reconstruction via Multi-Stage Sketched Gradientscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 4; 2025: 6; 2026: 2.

15 papers.

Sort:

By area: