mlsanityData to 7 Oct 2026

Second-Order KKT Guarantees for Bregman ADMM in Nonconvex and Non-Lipschitz Optimization

arXiv 2606.28307 ↗First posted 26 Jun 2026math.OC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We analyze Bregman ADMM for nonconvex linearly constrained problems under two-sided relative smoothness, a condition that replaces the standard Lipschitz gradient assumption with a Hessian comparison relative to a Bregman kernel. This setting covers polynomial objectives arising in matrix and tensor models for which a global Lipschitz-gradient constant need not exist. We show that on an invariant open state-space domain, one iteration of Bregman ADMM defines a smooth primal--dual fixed-point map whose strict-saddle KKT points are unstable fixed points; consequently, from random initialization the iterates converge to a strict saddle with probability zero. Combined with existing first-order convergence results, this yields almost-sure second-order stationarity of limiting KKT points. We extend the analysis to a multi-block star consensus formulation for distributed optimization. The technical novelty lies in a determinant reduction with a Bregman-specific symmetrization and scaling step in the two block spectral argument, together with a null space cancellation exploiting the star graph structure in the consensus case. Numerical experiments on distributed matrix factorization illustrate the theory, and a symmetric tensor factorization example demonstrates the broader Bregman proximal splitting idea beyond the separable consensus setting.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 46 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

18 of 46 references.

References · 18

  1. 2015Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decompositioncited by 241
  2. 2014EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimizationcited by 160
  3. 2016Matrix Completion has No Spurious Local Minimumcited by 124
  4. 2015Global Convergence of ADMM in Nonconvex Nonsmooth Optimizationcited by 98
  5. 2014Convergence Analysis of Alternating Direction Method of Multipliers for a Family of Nonconvex Problemscited by 64
  6. 2016On Nonconvex Decentralized Gradient Descentcited by 42
  7. 2017First Order Methods beyond Convexity and Lipschitz Gradient Continuity with Applications to Quadratic Inverse Problemscited by 37
  8. 2019First-order methods almost always avoid saddle points: the case of vanishing step-sizescited by 35
  9. 2013Bregman Alternating Direction Method of Multiplierscited by 19
  10. 2018Learning Deep Models: Critical Points and Local Opennesscited by 10
  11. 2015Convergence of multi-block Bregman ADMM for nonconvex composite problemscited by 8
  12. 2020Convergence for nonconvex ADMM, with applications to CT imagingcited by 8
6 more
  1. 2014Convergence of Bregman alternating direction method with multipliers for nonconvex composite problemscited by 7
  2. 2021A Decentralized Primal-Dual Framework for Non-convex Smooth Consensus Optimizationcited by 5
  3. 2017Convergence rate bounds for a proximal ADMM with over-relaxation stepsize parameter for solving nonconvex linearly constrained problemscited by 3
  4. 2019Provable Bregman-divergence based Methods for Nonconvex and Non-Lipschitz Problemscited by 3
  5. 2024Bregman Proximal Linearized ADMM for Minimizing Separable Sums Coupled by a Difference of Functionscited by 2
  6. 2022Local and Global Convergence of General Burer-Monteiro Tensor Optimizationscited by 1

Built on by

Not cited yet.