Equilibrium bias and convergence in augmented primal--dual dynamics with sampled constraints
Not on the map. Why?
Abstract (arXiv)
This work studies the stability and convergence of augmented primal-dual dynamics when constraint values are estimated from samples. Unbiased constraint observations can produce a biased augmented multiplier signal, shifting the equilibria of the mean dynamics. For componentwise inequalities, we give a necessary and sufficient condition for preserving the Karush-Kuhn-Tucker (KKT) equilibria and construct a convex example with a locally exponentially stable equilibrium that violates complementarity. To address this bias, constraint values are estimated recursively before forming the augmented multiplier signal. For smooth convex conic problems, a joint energy analysis establishes boundedness of the primal, dual, and estimation states, vanishing estimation error, and almost sure convergence of the primal-dual iterates to a single KKT point under global regularity and bounded conditional second moments. The result allows nonunique solutions and multipliers while keeping the number of samples per iteration fixed. Numerical studies illustrate the predicted equilibrium bias and examine convergence with nonunique KKT points and nonlinear constraints.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 20 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
10 of 20 references.
References · 10
- 2021Convex optimizationcited by 2,515
- 2014Stochastic Compositional Gradient Descent: Algorithms for Minimizing Compositions of Expected-Value Functionscited by 95
- 2020Solving Stochastic Compositional Optimization is Nearly as Easy as Solving Stochastic Optimizationcited by 51
- 2016Accelerating Stochastic Composition Optimizationcited by 46
- 2018On the Exponential Stability of Primal-Dual Gradient Dynamicscited by 12
- 2021Solving Stochastic Optimization with Expectation Constraints Efficiently by a Stochastic Augmented Lagrangian-Type Algorithmcited by 5
- 2019Semi-Global Exponential Stability of Augmented Primal-Dual Gradient Dynamics for Constrained Convex Optimizationcited by 4
- 2022Stochastic Compositional Optimization with Compositional Constraintscited by 4
- 2020Stochastic Compositional Gradient Descent under Compositional Constraintscited by 3
- 2024Stochastic Compositional Minimax Optimization with Provable Convergence Guaranteescited by 1
Built on by
Not cited yet.