First Order Methods beyond Convexity and Lipschitz Gradient Continuity with Applications to Quadratic Inverse Problems
Not on the map. Why?
Abstract (arXiv)
We focus on nonconvex and nonsmooth minimization problems with a composite objective, where the differentiable part of the objective is freed from the usual and restrictive global Lipschitz gradient continuity assumption. This longstanding smoothness restriction is pervasive in first order methods (FOM), and was recently circumvent for convex composite optimization by Bauschke, Bolte and Teboulle, through a simple and elegant framework which captures, all at once, the geometry of the function and of the feasible set. Building on this work, we tackle genuine nonconvex problems. We first complement and extend their approach to derive a full extended descent lemma by introducing the notion of smooth adaptable functions. We then consider a Bregman-based proximal gradient methods for the nonconvex composite model with smooth adaptable functions, which is proven to globally converge to a critical point under natural assumptions on the problem's data. To illustrate the power and potential of our general framework and results, we consider a broad class of quadratic inverse problems with sparsity constraints which arises in many fundamental applications, and we apply our approach to derive new globally convergent schemes for this class.
Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 8; 2023: 5; 2024: 4; 2025: 6; 2026: 10.
37 papers.
Sort:
By area:
- 2022Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimizationcited by 43
- 2021Oracle Complexity in Nonsmooth Nonconvex Optimizationcited by 39
- 2023Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse Problemscited by 14
- 2021Joint Majorization-Minimization for Nonnegative Matrix Factorization with the β-divergencecited by 7
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopescited by 7
- 2023Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learningcited by 7
- 2025Deep Equilibrium models for Poisson Imaging Inverse problems via Mirror Descentcited by 7
- 2022Learning Graph Structure from Convolutional Mixturescited by 5
- 2023Convergent plug-and-play with proximal denoiser and unconstrained regularization parametercited by 5
- 2021Block Alternating Bregman Majorization Minimization with Extrapolationcited by 4
- 2021Adaptive first-order methods revisited: Convex optimization without Lipschitz requirementscited by 4
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithmscited by 4
25 more
- 2025An Accelerated Alternating Partial Bregman Algorithm for ReLU-based Matrix Decompositioncited by 4
- 2024Spurious Stationarity and Hardness Results for Bregman Proximal-Type Algorithmscited by 3
- 2024Stable Phase Retrieval with Mirror Descentcited by 3
- 2025On exploration of an interior mirror descent flow for stochastic nonconvex constrained problemcited by 3
- 2022Provable Phase Retrieval with Mirror Descentcited by 2
- 2022Sharper Bounds for Proximal Gradient Algorithms with Errorscited by 1
- 2023Efficient Alternating Minimization Solvers for Wyner Multi-View Unsupervised Learningcited by 1
- 2025An Efficient Alternating Algorithm for ReLU-based Symmetric Matrix Decompositioncited by 1
- 2026Shuffling the Stochastic Mirror Descent via Dual Lipschitz Continuity and Kernel Conditioningcited by 1
- 2022A Nonlocal Graph-PDE and Higher-Order Geometric Integration for Image Labelingcited by 0
- 2022SPIRAL: A superlinearly convergent incremental proximal algorithm for nonconvex finite sum minimizationcited by 0
- 2022A Variational Approach for Joint Image Recovery and Feature Extraction Based on Spatially-Varying Generalised Gaussian Modelscited by 0
- 2024Edge-guided Low-light Image Enhancement with Inertial Bregman Alternating Linearized Minimizationcited by 0
- 2024Low Complexity Regularized Phase Retrievalcited by 0
- 2025Joint Cooperative and Non-Cooperative Localization in WSNs with Distributed Scaled Proximal ADMM Algorithmscited by 0
- 2025On the Tension Between Optimality and Adversarial Robustness in Policy Optimizationcited by 0
- 2026External Division of Two Bregman Proximity Operators for Poisson Inverse Problemscited by 0
- 2026A New Kernel Regularity Condition for Distributed Mirror Descent: Broader Coverage and Simpler Analysiscited by 0
- 2026Self-Tuning Regularization for Image Scanning Microscopycited by 0
- 2026Second-Order KKT Guarantees for Bregman ADMM in Nonconvex and Non-Lipschitz Optimizationcited by 0
- 2026Stochastic Saddle Avoidance Beyond Unit Excitation and Smoothness: A Pathwise Lyapunov-Perron Frameworkcited by 0
- 2026A geometry-based deep equilibrium model for image restoration under multiplicative Gamma noisecited by 0
- 2026Establishing Boundary KKT Convergence of Mirror Descent through Reparameterizationcited by 0
- 2026Adaptive Bregman Proximal Stochastic Gradient with a Stabilized Barzilai--Borwein Step Sizecited by 0
- 2026GeoPair: Geometry-Preserving Cross-Layer Factorization for Training-Free Transformer Compressioncited by 0
- 2026GeoPair: Geometry-Preserving Cross-Layer Factorization for Training-Free Transformer Compression22 Sep 2026
- 2026Adaptive Bregman Proximal Stochastic Gradient with a Stabilized Barzilai--Borwein Step Size12 Aug 2026
- 2026Establishing Boundary KKT Convergence of Mirror Descent through Reparameterization7 Aug 2026
- 2026A geometry-based deep equilibrium model for image restoration under multiplicative Gamma noise5 Aug 2026
- 2026Stochastic Saddle Avoidance Beyond Unit Excitation and Smoothness: A Pathwise Lyapunov-Perron Framework4 Aug 2026
- 2026Second-Order KKT Guarantees for Bregman ADMM in Nonconvex and Non-Lipschitz Optimization26 Jun 2026
- 2026Self-Tuning Regularization for Image Scanning Microscopy29 May 2026
- 2026Shuffling the Stochastic Mirror Descent via Dual Lipschitz Continuity and Kernel Conditioning17 Mar 2026
- 2026A New Kernel Regularity Condition for Distributed Mirror Descent: Broader Coverage and Simpler Analysis13 Mar 2026
- 2026External Division of Two Bregman Proximity Operators for Poisson Inverse Problems12 Feb 2026
- 2025On the Tension Between Optimality and Adversarial Robustness in Policy Optimization1 Dec 2025
- 2025Joint Cooperative and Non-Cooperative Localization in WSNs with Distributed Scaled Proximal ADMM Algorithms21 Sep 2025
25 more
- 2025On exploration of an interior mirror descent flow for stochastic nonconvex constrained problem21 Jul 2025
- 2025Deep Equilibrium models for Poisson Imaging Inverse problems via Mirror Descent15 Jul 2025
- 2025An Efficient Alternating Algorithm for ReLU-based Symmetric Matrix Decomposition21 Mar 2025
- 2025An Accelerated Alternating Partial Bregman Algorithm for ReLU-based Matrix Decomposition4 Mar 2025
- 2024Low Complexity Regularized Phase Retrieval23 Jul 2024
- 2024Stable Phase Retrieval with Mirror Descent17 May 2024
- 2024Spurious Stationarity and Hardness Results for Bregman Proximal-Type Algorithms11 Apr 2024
- 2024Edge-guided Low-light Image Enhancement with Inertial Bregman Alternating Linearized Minimization2 Mar 2024
- 2023Convergent plug-and-play with proximal denoiser and unconstrained regularization parameter2 Nov 2023
- 2023Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning26 Jun 2023
- 2023Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse Problems6 Jun 2023
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithms25 May 2023
- 2023Efficient Alternating Minimization Solvers for Wyner Multi-View Unsupervised Learning28 Mar 2023
- 2022Provable Phase Retrieval with Mirror Descent17 Oct 2022
- 2022Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimization12 Sep 2022
- 2022A Variational Approach for Joint Image Recovery and Feature Extraction Based on Spatially-Varying Generalised Gaussian Models3 Sep 2022
- 2022SPIRAL: A superlinearly convergent incremental proximal algorithm for nonconvex finite sum minimization17 Jul 2022
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopes10 Jul 2022
- 2022Learning Graph Structure from Convolutional Mixtures19 May 2022
- 2022A Nonlocal Graph-PDE and Higher-Order Geometric Integration for Image Labeling9 May 2022
- 2022Sharper Bounds for Proximal Gradient Algorithms with Errors4 Mar 2022
- 2021Adaptive first-order methods revisited: Convex optimization without Lipschitz requirements16 Jul 2021
- 2021Block Alternating Bregman Majorization Minimization with Extrapolation9 Jul 2021
- 2021Joint Majorization-Minimization for Nonnegative Matrix Factorization with the β-divergence29 Jun 2021
- 2021Oracle Complexity in Nonsmooth Nonconvex Optimization14 Apr 2021
- 2022Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimizationcited by 43
- 2021Oracle Complexity in Nonsmooth Nonconvex Optimizationcited by 39
- 2023Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse Problemscited by 14
- 2021Joint Majorization-Minimization for Nonnegative Matrix Factorization with the β-divergencecited by 7
- 2022Bregman Proximal Langevin Monte Carlo via Bregman--Moreau Envelopescited by 7
- 2023Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learningcited by 7
- 2025Deep Equilibrium models for Poisson Imaging Inverse problems via Mirror Descentcited by 7
- 2022Learning Graph Structure from Convolutional Mixturescited by 5
- 2023Convergent plug-and-play with proximal denoiser and unconstrained regularization parametercited by 5
- 2021Block Alternating Bregman Majorization Minimization with Extrapolationcited by 4
- 2021Adaptive first-order methods revisited: Convex optimization without Lipschitz requirementscited by 4
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithmscited by 4
12 most cited of 36 All 36 (JSON)
- 2026GeoPair: Geometry-Preserving Cross-Layer Factorization for Training-Free Transformer Compression22 Sep 2026
- 2026Adaptive Bregman Proximal Stochastic Gradient with a Stabilized Barzilai--Borwein Step Size12 Aug 2026
- 2026Establishing Boundary KKT Convergence of Mirror Descent through Reparameterization7 Aug 2026
- 2026A geometry-based deep equilibrium model for image restoration under multiplicative Gamma noise5 Aug 2026
- 2026Stochastic Saddle Avoidance Beyond Unit Excitation and Smoothness: A Pathwise Lyapunov-Perron Framework4 Aug 2026
- 2026Second-Order KKT Guarantees for Bregman ADMM in Nonconvex and Non-Lipschitz Optimization26 Jun 2026
- 2026Self-Tuning Regularization for Image Scanning Microscopy29 May 2026
- 2026Shuffling the Stochastic Mirror Descent via Dual Lipschitz Continuity and Kernel Conditioning17 Mar 2026
- 2026A New Kernel Regularity Condition for Distributed Mirror Descent: Broader Coverage and Simpler Analysis13 Mar 2026
- 2026External Division of Two Bregman Proximity Operators for Poisson Inverse Problems12 Feb 2026
- 2025Joint Cooperative and Non-Cooperative Localization in WSNs with Distributed Scaled Proximal ADMM Algorithms21 Sep 2025
- 2025On exploration of an interior mirror descent flow for stochastic nonconvex constrained problem21 Jul 2025
12 newest of 36 All 36 (JSON)