A Stochastic Sequential Quadratic Optimization Algorithm for Nonlinear Equality Constrained Optimization with Rank-Deficient Jacobians
Not on the map. Why?
Abstract (arXiv)
A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The algorithmic structure of the proposed method is based on a step decomposition strategy that is known in the literature to be widely effective in practice, wherein each search direction is computed as the sum of a normal step (toward linearized feasibility) and a tangential step (toward objective decrease in the null space of the constraint Jacobian). However, the proposed method is unique from others in the literature in that it both allows the use of stochastic objective gradient estimates and possesses convergence guarantees even in the setting in which the constraint Jacobians may be rank deficient. The results of numerical experiments demonstrate that the algorithm offers superior performance when compared to popular alternatives.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 9 of its 32 references that are in the map. First posted on arXiv 24 Jun 2021.
Builds on
9 of 32 references.
References · 9
- 2016Optimization Methods for Large-Scale Machine Learningcited by 1,150
- 2018Stochastic subgradient method converges on tame functionscited by 124
- 2016Stochastic Frank-Wolfe Methods for Nonconvex Optimizationcited by 41
- 2016Variance-Reduced and Projection-Free Stochastic Optimizationcited by 40
- 2019One Sample Stochastic Frank-Wolfecited by 32
- 2020Sequential Quadratic Optimization for Nonlinear Equality Constrained Stochastic Optimizationcited by 30
- 2021An Adaptive Stochastic Sequential Quadratic Programming with Differentiable Exact Augmented Lagrangianscited by 25
- 2019Stochastic Frank-Wolfe for Composite Convex Minimizationcited by 9
- 2018Generalized Stochastic Frank-Wolfe Algorithm with Stochastic "Substitute" Gradient for Structured Convex Optimizationcited by 8
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 5; 2024: 5; 2025: 4; 2026: 5.
22 papers.
Sort:
- 2022Fully Stochastic Trust-Region Sequential Quadratic Programming for Equality-Constrained Optimization Problemscited by 21
- 2021Inequality Constrained Stochastic Nonlinear Optimization via Active-Set Sequential Quadratic Programmingcited by 17
- 2023Oracle Complexity of Single-Loop Switching Subgradient Methods for Non-Smooth Weakly Convex Functional Constrained Optimizationcited by 11
- 2024Variance-reduced first-order methods for deterministically constrained stochastic nonconvex optimization with strong convergence guaranteescited by 11
- 2022Statistical Inference of Constrained Stochastic Optimization via Sketched Sequential Quadratic Programmingcited by 10
- 2023A Sequential Quadratic Programming Method with High Probability Complexity Bounds for Nonlinear Equality Constrained Stochastic Optimizationcited by 8
- 2023A Stochastic-Gradient-based Interior-Point Algorithm for Solving Smooth Bound-Constrained Optimization Problemscited by 8
- 2023Constrained Optimization via Exact Augmented Lagrangian and Randomized Iterative Sketchingcited by 5
- 2023Almost-sure convergence of iterates and multipliers in stochastic sequential quadratic optimizationcited by 5
- 2024Trust-Region Sequential Quadratic Programming for Stochastic Optimization with Random Modelscited by 5
- 2025High Probability Complexity Bounds of Trust-Region Stochastic Sequential Quadratic Programming with Heavy-Tailed Noisecited by 4
- 2026A Trust-Region Interior-Point Stochastic Sequential Quadratic Programming Methodcited by 2
10 more
- 2024Single-Loop Deterministic and Stochastic Interior-Point Algorithms for Nonlinearly Constrained Optimizationcited by 1
- 2024A Trust-Region Algorithm for Noisy Equality Constrained Optimizationcited by 1
- 2024Stochastic interior-point methods for smooth conic optimization with applicationscited by 1
- 2025humancompatible.train: Implementing Optimization Algorithms for Stochastically-Constrained Stochastic Optimization Problemscited by 1
- 2025Online Statistical Inference of Constrained Stochastic Optimization via Random Scalingcited by 0
- 2025Benchmarking Stochastic Approximation Algorithms for Fairness-Constrained Training of Deep Neural Networkscited by 0
- 2026TRSVR: An Adaptive Stochastic Trust-Region Method with Variance Reductioncited by 0
- 2026Stochastic Trust-Region Methods for Over-parameterized Modelscited by 0
- 2026Stochastic Penalty-Barrier Method for Constrained Machine Learningcited by 0
- 2026TR-SSQP: A Trust-Region Method for Constrained Stochastic Optimization under Heavy-Tailed Noisecited by 0
- 2026TR-SSQP: A Trust-Region Method for Constrained Stochastic Optimization under Heavy-Tailed Noise25 Sep 2026
- 2026Stochastic Penalty-Barrier Method for Constrained Machine Learning18 May 2026
- 2026Stochastic Trust-Region Methods for Over-parameterized Models15 Apr 2026
- 2026A Trust-Region Interior-Point Stochastic Sequential Quadratic Programming Method10 Mar 2026
- 2026TRSVR: An Adaptive Stochastic Trust-Region Method with Variance Reduction21 Jan 2026
- 2025humancompatible.train: Implementing Optimization Algorithms for Stochastically-Constrained Stochastic Optimization Problems25 Sep 2025
- 2025Benchmarking Stochastic Approximation Algorithms for Fairness-Constrained Training of Deep Neural Networks5 Jul 2025
- 2025Online Statistical Inference of Constrained Stochastic Optimization via Random Scaling23 May 2025
- 2025High Probability Complexity Bounds of Trust-Region Stochastic Sequential Quadratic Programming with Heavy-Tailed Noise24 Mar 2025
- 2024Stochastic interior-point methods for smooth conic optimization with applications17 Dec 2024
- 2024A Trust-Region Algorithm for Noisy Equality Constrained Optimization4 Nov 2024
- 2024Trust-Region Sequential Quadratic Programming for Stochastic Optimization with Random Models24 Sep 2024
10 more
- 2024Variance-reduced first-order methods for deterministically constrained stochastic nonconvex optimization with strong convergence guarantees16 Sep 2024
- 2024Single-Loop Deterministic and Stochastic Interior-Point Algorithms for Nonlinearly Constrained Optimization29 Aug 2024
- 2023Almost-sure convergence of iterates and multipliers in stochastic sequential quadratic optimization7 Aug 2023
- 2023Constrained Optimization via Exact Augmented Lagrangian and Randomized Iterative Sketching28 May 2023
- 2023A Stochastic-Gradient-based Interior-Point Algorithm for Solving Smooth Bound-Constrained Optimization Problems28 Apr 2023
- 2023Oracle Complexity of Single-Loop Switching Subgradient Methods for Non-Smooth Weakly Convex Functional Constrained Optimization30 Jan 2023
- 2023A Sequential Quadratic Programming Method with High Probability Complexity Bounds for Nonlinear Equality Constrained Stochastic Optimization1 Jan 2023
- 2022Fully Stochastic Trust-Region Sequential Quadratic Programming for Equality-Constrained Optimization Problems29 Nov 2022
- 2022Statistical Inference of Constrained Stochastic Optimization via Sketched Sequential Quadratic Programming27 May 2022
- 2021Inequality Constrained Stochastic Nonlinear Optimization via Active-Set Sequential Quadratic Programming23 Sep 2021
- 2022Fully Stochastic Trust-Region Sequential Quadratic Programming for Equality-Constrained Optimization Problemscited by 21
- 2021Inequality Constrained Stochastic Nonlinear Optimization via Active-Set Sequential Quadratic Programmingcited by 17
- 2023Oracle Complexity of Single-Loop Switching Subgradient Methods for Non-Smooth Weakly Convex Functional Constrained Optimizationcited by 11
- 2024Variance-reduced first-order methods for deterministically constrained stochastic nonconvex optimization with strong convergence guaranteescited by 11
- 2022Statistical Inference of Constrained Stochastic Optimization via Sketched Sequential Quadratic Programmingcited by 10
- 2023A Sequential Quadratic Programming Method with High Probability Complexity Bounds for Nonlinear Equality Constrained Stochastic Optimizationcited by 8
- 2023A Stochastic-Gradient-based Interior-Point Algorithm for Solving Smooth Bound-Constrained Optimization Problemscited by 8
- 2023Constrained Optimization via Exact Augmented Lagrangian and Randomized Iterative Sketchingcited by 5
- 2023Almost-sure convergence of iterates and multipliers in stochastic sequential quadratic optimizationcited by 5
- 2024Trust-Region Sequential Quadratic Programming for Stochastic Optimization with Random Modelscited by 5
- 2025High Probability Complexity Bounds of Trust-Region Stochastic Sequential Quadratic Programming with Heavy-Tailed Noisecited by 4
- 2026A Trust-Region Interior-Point Stochastic Sequential Quadratic Programming Methodcited by 2
12 most cited of 22 All 22 (JSON)
- 2026TR-SSQP: A Trust-Region Method for Constrained Stochastic Optimization under Heavy-Tailed Noise25 Sep 2026
- 2026Stochastic Penalty-Barrier Method for Constrained Machine Learning18 May 2026
- 2026Stochastic Trust-Region Methods for Over-parameterized Models15 Apr 2026
- 2026A Trust-Region Interior-Point Stochastic Sequential Quadratic Programming Method10 Mar 2026
- 2026TRSVR: An Adaptive Stochastic Trust-Region Method with Variance Reduction21 Jan 2026
- 2025humancompatible.train: Implementing Optimization Algorithms for Stochastically-Constrained Stochastic Optimization Problems25 Sep 2025
- 2025Benchmarking Stochastic Approximation Algorithms for Fairness-Constrained Training of Deep Neural Networks5 Jul 2025
- 2025Online Statistical Inference of Constrained Stochastic Optimization via Random Scaling23 May 2025
- 2025High Probability Complexity Bounds of Trust-Region Stochastic Sequential Quadratic Programming with Heavy-Tailed Noise24 Mar 2025
- 2024Stochastic interior-point methods for smooth conic optimization with applications17 Dec 2024
- 2024A Trust-Region Algorithm for Noisy Equality Constrained Optimization4 Nov 2024
- 2024Trust-Region Sequential Quadratic Programming for Stochastic Optimization with Random Models24 Sep 2024
12 newest of 22 All 22 (JSON)