mlsanityData to 14 Oct 2026

A Stochastic Sequential Quadratic Optimization Algorithm for Nonlinear Equality Constrained Optimization with Rank-Deficient Jacobians

arXiv 2106.13015 ↗First posted 24 Jun 2021math.OC stat.MLcited by 22

Not on the map. Why?

Abstract (arXiv)

A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The algorithmic structure of the proposed method is based on a step decomposition strategy that is known in the literature to be widely effective in practice, wherein each search direction is computed as the sum of a normal step (toward linearized feasibility) and a tangential step (toward objective decrease in the null space of the constraint Jacobian). However, the proposed method is unique from others in the literature in that it both allows the use of stochastic objective gradient estimates and possesses convergence guarantees even in the setting in which the constraint Jacobians may be rank deficient. The results of numerical experiments demonstrate that the algorithm offers superior performance when compared to popular alternatives.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 9 of its 32 references that are in the map. First posted on arXiv 24 Jun 2021.

Builds on

9 of 32 references.

References · 9

  1. 2016Optimization Methods for Large-Scale Machine Learningcited by 1,150
  2. 2018Stochastic subgradient method converges on tame functionscited by 124
  3. 2016Stochastic Frank-Wolfe Methods for Nonconvex Optimizationcited by 41
  4. 2016Variance-Reduced and Projection-Free Stochastic Optimizationcited by 40
  5. 2019One Sample Stochastic Frank-Wolfecited by 32
  6. 2020Sequential Quadratic Optimization for Nonlinear Equality Constrained Stochastic Optimizationcited by 30
  7. 2021An Adaptive Stochastic Sequential Quadratic Programming with Differentiable Exact Augmented Lagrangianscited by 25
  8. 2019Stochastic Frank-Wolfe for Composite Convex Minimizationcited by 9
  9. 2018Generalized Stochastic Frank-Wolfe Algorithm with Stochastic "Substitute" Gradient for Structured Convex Optimizationcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 2; 2023: 5; 2024: 5; 2025: 4; 2026: 5.

22 papers.

Sort:

  1. 2022Fully Stochastic Trust-Region Sequential Quadratic Programming for Equality-Constrained Optimization Problemscited by 21
  2. 2021Inequality Constrained Stochastic Nonlinear Optimization via Active-Set Sequential Quadratic Programmingcited by 17
  3. 2023Oracle Complexity of Single-Loop Switching Subgradient Methods for Non-Smooth Weakly Convex Functional Constrained Optimizationcited by 11
  4. 2024Variance-reduced first-order methods for deterministically constrained stochastic nonconvex optimization with strong convergence guaranteescited by 11
  5. 2022Statistical Inference of Constrained Stochastic Optimization via Sketched Sequential Quadratic Programmingcited by 10
  6. 2023A Sequential Quadratic Programming Method with High Probability Complexity Bounds for Nonlinear Equality Constrained Stochastic Optimizationcited by 8
  7. 2023A Stochastic-Gradient-based Interior-Point Algorithm for Solving Smooth Bound-Constrained Optimization Problemscited by 8
  8. 2023Constrained Optimization via Exact Augmented Lagrangian and Randomized Iterative Sketchingcited by 5
  9. 2023Almost-sure convergence of iterates and multipliers in stochastic sequential quadratic optimizationcited by 5
  10. 2024Trust-Region Sequential Quadratic Programming for Stochastic Optimization with Random Modelscited by 5
  11. 2025High Probability Complexity Bounds of Trust-Region Stochastic Sequential Quadratic Programming with Heavy-Tailed Noisecited by 4
  12. 2026A Trust-Region Interior-Point Stochastic Sequential Quadratic Programming Methodcited by 2
10 more
  1. 2024Single-Loop Deterministic and Stochastic Interior-Point Algorithms for Nonlinearly Constrained Optimizationcited by 1
  2. 2024A Trust-Region Algorithm for Noisy Equality Constrained Optimizationcited by 1
  3. 2024Stochastic interior-point methods for smooth conic optimization with applicationscited by 1
  4. 2025humancompatible.train: Implementing Optimization Algorithms for Stochastically-Constrained Stochastic Optimization Problemscited by 1
  5. 2025Online Statistical Inference of Constrained Stochastic Optimization via Random Scalingcited by 0
  6. 2025Benchmarking Stochastic Approximation Algorithms for Fairness-Constrained Training of Deep Neural Networkscited by 0
  7. 2026TRSVR: An Adaptive Stochastic Trust-Region Method with Variance Reductioncited by 0
  8. 2026Stochastic Trust-Region Methods for Over-parameterized Modelscited by 0
  9. 2026Stochastic Penalty-Barrier Method for Constrained Machine Learningcited by 0
  10. 2026TR-SSQP: A Trust-Region Method for Constrained Stochastic Optimization under Heavy-Tailed Noisecited by 0