Self-Supervised Learning of Iterative Solvers for Constrained Optimization
Not on the map. Why?
Abstract (arXiv)
The real-time solution of parametric optimization problems is critical for applications that demand high accuracy under tight real-time constraints, such as model predictive control. To this end, this work presents a learning-based iterative solver for constrained optimization, comprising a neural network predictor that generates initial primal-dual solution estimates, followed by a learned iterative solver that refines these estimates to reach high accuracy. We introduce a novel loss function based on Karush-Kuhn-Tucker (KKT) optimality conditions, enabling fully self-supervised training without pre-solved optimizer solutions. Theoretical guarantees ensure that the training loss function attains minima exclusively at KKT points. A convexification procedure enables application to nonconvex problems while preserving these guarantees. Experiments on two nonconvex case studies demonstrate speedups of up to one order of magnitude compared to state-of-the-art solvers such as IPOPT, while achieving orders of magnitude higher accuracy than competing learning-based approaches.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 28 of its 52 references that are in the map. First posted on arXiv 12 Sep 2024.
Builds on
28 of 52 references.
References · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2021Convex optimizationcited by 2,479
- 2019On the Convergence of Adam and Beyondcited by 834
- 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 633
- 2017Smart "Predict, then Optimize"cited by 332
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2016Learning to Optimizecited by 195
- 2021DC3: A learning method for optimization with hard constraintscited by 181
- 2017OSQP: An Operator Splitting Solver for Quadratic Programscited by 156
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
16 more
- 2022Tutorial on amortized optimizationcited by 83
- 2022Self-Supervised Primal-Dual Learning for Constrained Optimizationcited by 60
- 2018Efficient representation and approximation of model predictive control laws via deep learningcited by 55
- 2018Learning an Approximate Model Predictive Controller with Guaranteescited by 54
- 2019Large Scale Model Predictive Control with Neural Networks and Primal Active Setscited by 28
- 2022End-to-End Learning to Warm-Start for Real-Time Quadratic Optimizationcited by 25
- 2021Fast Approximations for Job Shop Scheduling: A Lagrangian Dual Deep Learning Methodcited by 20
- 2019Safe and Fast Tracking on a Robot Manipulator: Robust MPC and Neural Network Controlcited by 17
- 2021Reliably-stabilizing piecewise-affine neural network controllerscited by 13
- 2019Probabilistic performance validation of deep learning-based robust NMPC controllerscited by 10
- 2020Stability and feasibility of neural network-based controllers via output range analysiscited by 10
- 2023Neural Networks for Fast Optimisation in Model Predictive Control: A Reviewcited by 10
- 2018Deep Learning-Based Model Predictive Control for Resonant Power Converterscited by 5
- 2019FBstab: A Stabilized Semismooth Quadratic Programming Algorithm with Applications in Model Predictive Controlcited by 4
- 2023An Improved Data Augmentation Scheme for Model Predictive Control Policy Approximationcited by 3
- 2023Error bounds for maxout neural network approximations of model predictive controlcited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.