Second-Order KKT Guarantees for Bregman ADMM in Nonconvex and Non-Lipschitz Optimization
Not on the map. Why?
Abstract (arXiv)
We analyze Bregman ADMM for nonconvex linearly constrained problems under two-sided relative smoothness, a condition that replaces the standard Lipschitz gradient assumption with a Hessian comparison relative to a Bregman kernel. This setting covers polynomial objectives arising in matrix and tensor models for which a global Lipschitz-gradient constant need not exist. We show that on an invariant open state-space domain, one iteration of Bregman ADMM defines a smooth primal--dual fixed-point map whose strict-saddle KKT points are unstable fixed points; consequently, from random initialization the iterates converge to a strict saddle with probability zero. Combined with existing first-order convergence results, this yields almost-sure second-order stationarity of limiting KKT points. We extend the analysis to a multi-block star consensus formulation for distributed optimization. The technical novelty lies in a determinant reduction with a Bregman-specific symmetrization and scaling step in the two block spectral argument, together with a null space cancellation exploiting the star graph structure in the consensus case. Numerical experiments on distributed matrix factorization illustrate the theory, and a symmetric tensor factorization example demonstrates the broader Bregman proximal splitting idea beyond the separable consensus setting.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 46 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
18 of 46 references.
References · 18
- 2015Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decompositioncited by 241
- 2014EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimizationcited by 160
- 2016Matrix Completion has No Spurious Local Minimumcited by 124
- 2015Global Convergence of ADMM in Nonconvex Nonsmooth Optimizationcited by 98
- 2014Convergence Analysis of Alternating Direction Method of Multipliers for a Family of Nonconvex Problemscited by 64
- 2016On Nonconvex Decentralized Gradient Descentcited by 42
- 2017First Order Methods beyond Convexity and Lipschitz Gradient Continuity with Applications to Quadratic Inverse Problemscited by 37
- 2019First-order methods almost always avoid saddle points: the case of vanishing step-sizescited by 35
- 2013Bregman Alternating Direction Method of Multiplierscited by 19
- 2018Learning Deep Models: Critical Points and Local Opennesscited by 10
- 2015Convergence of multi-block Bregman ADMM for nonconvex composite problemscited by 8
- 2020Convergence for nonconvex ADMM, with applications to CT imagingcited by 8
6 more
- 2014Convergence of Bregman alternating direction method with multipliers for nonconvex composite problemscited by 7
- 2021A Decentralized Primal-Dual Framework for Non-convex Smooth Consensus Optimizationcited by 5
- 2017Convergence rate bounds for a proximal ADMM with over-relaxation stepsize parameter for solving nonconvex linearly constrained problemscited by 3
- 2019Provable Bregman-divergence based Methods for Nonconvex and Non-Lipschitz Problemscited by 3
- 2024Bregman Proximal Linearized ADMM for Minimizing Separable Sums Coupled by a Difference of Functionscited by 2
- 2022Local and Global Convergence of General Burer-Monteiro Tensor Optimizationscited by 1
Built on by
Not cited yet.