mlsanityData to 14 Oct 2026

First Order Methods beyond Convexity and Lipschitz Gradient Continuity with Applications to Quadratic Inverse Problems

arXiv 1706.06461 ↗First posted 20 Jun 2017math.OC cs.NA math.NAcited by 37

Not on the map. Why?

Abstract (arXiv)

We focus on nonconvex and nonsmooth minimization problems with a composite objective, where the differentiable part of the objective is freed from the usual and restrictive global Lipschitz gradient continuity assumption. This longstanding smoothness restriction is pervasive in first order methods (FOM), and was recently circumvent for convex composite optimization by Bauschke, Bolte and Teboulle, through a simple and elegant framework which captures, all at once, the geometry of the function and of the feasible set. Building on this work, we tackle genuine nonconvex problems. We first complement and extend their approach to derive a full extended descent lemma by introducing the notion of smooth adaptable functions. We then consider a Bregman-based proximal gradient methods for the nonconvex composite model with smooth adaptable functions, which is proven to globally converge to a critical point under natural assumptions on the problem's data. To illustrate the power and potential of our general framework and results, we consider a broad class of quadratic inverse problems with sparsity constraints which arises in many fundamental applications, and we apply our approach to derive new globally convergent schemes for this class.

Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Jun 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 4; 2022: 8; 2023: 5; 2024: 4; 2025: 6; 2026: 10.

37 papers.

Sort:

By area:

  1. 2022Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimizationcited by 43
  2. 2021Oracle Complexity in Nonsmooth Nonconvex Optimizationcited by 39
  3. 2023Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse Problemscited by 14
  4. 2021Joint Majorization-Minimization for Nonnegative Matrix Factorization with the β-divergencecited by 7
  5. 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopescited by 7
  6. 2023Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learningcited by 7
  7. 2025Deep Equilibrium models for Poisson Imaging Inverse problems via Mirror Descentcited by 7
  8. 2022Learning Graph Structure from Convolutional Mixturescited by 5
  9. 2023Convergent plug-and-play with proximal denoiser and unconstrained regularization parametercited by 5
  10. 2021Block Alternating Bregman Majorization Minimization with Extrapolationcited by 4
  11. 2021Adaptive first-order methods revisited: Convex optimization without Lipschitz requirementscited by 4
  12. 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithmscited by 4
25 more
  1. 2025An Accelerated Alternating Partial Bregman Algorithm for ReLU-based Matrix Decompositioncited by 4
  2. 2024Spurious Stationarity and Hardness Results for Bregman Proximal-Type Algorithmscited by 3
  3. 2024Stable Phase Retrieval with Mirror Descentcited by 3
  4. 2025On exploration of an interior mirror descent flow for stochastic nonconvex constrained problemcited by 3
  5. 2022Provable Phase Retrieval with Mirror Descentcited by 2
  6. 2022Sharper Bounds for Proximal Gradient Algorithms with Errorscited by 1
  7. 2023Efficient Alternating Minimization Solvers for Wyner Multi-View Unsupervised Learningcited by 1
  8. 2025An Efficient Alternating Algorithm for ReLU-based Symmetric Matrix Decompositioncited by 1
  9. 2026Shuffling the Stochastic Mirror Descent via Dual Lipschitz Continuity and Kernel Conditioningcited by 1
  10. 2022A Nonlocal Graph-PDE and Higher-Order Geometric Integration for Image Labelingcited by 0
  11. 2022SPIRAL: A superlinearly convergent incremental proximal algorithm for nonconvex finite sum minimizationcited by 0
  12. 2022A Variational Approach for Joint Image Recovery and Feature Extraction Based on Spatially-Varying Generalised Gaussian Modelscited by 0
  13. 2024Edge-guided Low-light Image Enhancement with Inertial Bregman Alternating Linearized Minimizationcited by 0
  14. 2024Low Complexity Regularized Phase Retrievalcited by 0
  15. 2025Joint Cooperative and Non-Cooperative Localization in WSNs with Distributed Scaled Proximal ADMM Algorithmscited by 0
  16. 2025On the Tension Between Optimality and Adversarial Robustness in Policy Optimizationcited by 0
  17. 2026External Division of Two Bregman Proximity Operators for Poisson Inverse Problemscited by 0
  18. 2026A New Kernel Regularity Condition for Distributed Mirror Descent: Broader Coverage and Simpler Analysiscited by 0
  19. 2026Self-Tuning Regularization for Image Scanning Microscopycited by 0
  20. 2026Second-Order KKT Guarantees for Bregman ADMM in Nonconvex and Non-Lipschitz Optimizationcited by 0
  21. 2026Stochastic Saddle Avoidance Beyond Unit Excitation and Smoothness: A Pathwise Lyapunov-Perron Frameworkcited by 0
  22. 2026A geometry-based deep equilibrium model for image restoration under multiplicative Gamma noisecited by 0
  23. 2026Establishing Boundary KKT Convergence of Mirror Descent through Reparameterizationcited by 0
  24. 2026Adaptive Bregman Proximal Stochastic Gradient with a Stabilized Barzilai--Borwein Step Sizecited by 0
  25. 2026GeoPair: Geometry-Preserving Cross-Layer Factorization for Training-Free Transformer Compressioncited by 0