mlsanityData to 7 Oct 2026

From exponential to finite/fixed-time stability: Applications to optimization

arXiv 2409.11713 ↗First posted 18 Sep 2024math.OC cs.LG cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

The development of finite/fixed-time stable optimization algorithms typically involves study of specific problem instances. The lack of a unified framework hinders understanding of more sophisticated algorithms, e.g., primal-dual gradient flow dynamics. The purpose of this paper is to address the following question: Given an exponentially stable optimization algorithm, can it be modified to obtain a finite/fixed-time stable algorithm? We provide an affirmative answer, demonstrate how the solution can be computed on a finite-time interval via a simple scaling of the right-hand-side of the original dynamics, and certify the desired properties of the modified algorithm using the Lyapunov function that proves exponential stability of the original system. Finally, we examine nonsmooth composite optimization problems and smooth problems with linear constraints to demonstrate the merits of our approach.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 40 references that are in the map. First posted on arXiv 18 Sep 2024.

Builds on

17 of 40 references.

References · 17

  1. 2016Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Lojasiewicz Conditioncited by 526
  2. 2015A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insightscited by 203
  3. 2016A Variational Perspective on Accelerated Methods in Optimizationcited by 108
  4. 2017Gradient Descent Can Take Exponential Time to Escape Saddle Pointscited by 74
  5. 2017Revisiting Normalized Gradient Descent: Fast Evasion of Saddle Pointscited by 28
  6. 2020Optimization with Momentum: Dynamical, Control-Theoretic, and Symplectic Perspectivescited by 27
  7. 2021On Constraints in First-Order Optimization: A View from Non-Smooth Dynamical Systemscited by 13
  8. 2018On the Exponential Stability of Primal-Dual Gradient Dynamicscited by 12
  9. 2022A Hamilton-Jacobi-based Proximal Operatorcited by 12
  10. 2016The proximal augmented Lagrangian method for nonsmooth composite optimizationcited by 11
  11. 2018Fixed-Time Stable Gradient Flows: Applications to Continuous-Time Optimizationcited by 10
  12. 2022Control Barrier Function Based Design of Gradient Flows for Constrained Nonlinear Programmingcited by 5
5 more
  1. 2018A Nonsmooth Dynamical Systems Perspective on Accelerated Extensions of ADMMcited by 4
  2. 2019Semi-Global Exponential Stability of Augmented Primal-Dual Gradient Dynamics for Constrained Convex Optimizationcited by 4
  3. 2019Fixed-Time Stable Proximal Dynamical System for Solving MVIPscited by 4
  4. 2017Stability and instability in saddle point dynamics -- Part Icited by 1
  5. 2021Time-Varying Optimization of LTI Systems via Projected Primal-Dual Gradient Flowscited by 1

Built on by

Not cited yet.