mlsanityData to 7 Oct 2026

Self-Supervised Learning of Iterative Solvers for Constrained Optimization

arXiv 2409.08066 ↗First posted 12 Sep 2024cs.LG math.OCcited by 3

Not on the map. Why?

Abstract (arXiv)

The real-time solution of parametric optimization problems is critical for applications that demand high accuracy under tight real-time constraints, such as model predictive control. To this end, this work presents a learning-based iterative solver for constrained optimization, comprising a neural network predictor that generates initial primal-dual solution estimates, followed by a learned iterative solver that refines these estimates to reach high accuracy. We introduce a novel loss function based on Karush-Kuhn-Tucker (KKT) optimality conditions, enabling fully self-supervised training without pre-solved optimizer solutions. Theoretical guarantees ensure that the training loss function attains minima exclusively at KKT points. A convexification procedure enables application to nonconvex problems while preserving these guarantees. Experiments on two nonconvex case studies demonstrate speedups of up to one order of magnitude compared to state-of-the-art solvers such as IPOPT, while achieving orders of magnitude higher accuracy than competing learning-based approaches.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 28 of its 52 references that are in the map. First posted on arXiv 12 Sep 2024.

Builds on

28 of 52 references.

References · 28

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  4. 2021Convex optimizationcited by 2,479
  5. 2019On the Convergence of Adam and Beyondcited by 834
  6. 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 633
  7. 2017Smart "Predict, then Optimize"cited by 332
  8. 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
  9. 2016Learning to Optimizecited by 195
  10. 2021DC3: A learning method for optimization with hard constraintscited by 181
  11. 2017OSQP: An Operator Splitting Solver for Quadratic Programscited by 156
  12. 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
16 more
  1. 2022Tutorial on amortized optimizationcited by 83
  2. 2022Self-Supervised Primal-Dual Learning for Constrained Optimizationcited by 60
  3. 2018Efficient representation and approximation of model predictive control laws via deep learningcited by 55
  4. 2018Learning an Approximate Model Predictive Controller with Guaranteescited by 54
  5. 2019Large Scale Model Predictive Control with Neural Networks and Primal Active Setscited by 28
  6. 2022End-to-End Learning to Warm-Start for Real-Time Quadratic Optimizationcited by 25
  7. 2021Fast Approximations for Job Shop Scheduling: A Lagrangian Dual Deep Learning Methodcited by 20
  8. 2019Safe and Fast Tracking on a Robot Manipulator: Robust MPC and Neural Network Controlcited by 17
  9. 2021Reliably-stabilizing piecewise-affine neural network controllerscited by 13
  10. 2019Probabilistic performance validation of deep learning-based robust NMPC controllerscited by 10
  11. 2020Stability and feasibility of neural network-based controllers via output range analysiscited by 10
  12. 2023Neural Networks for Fast Optimisation in Model Predictive Control: A Reviewcited by 10
  13. 2018Deep Learning-Based Model Predictive Control for Resonant Power Converterscited by 5
  14. 2019FBstab: A Stabilized Semismooth Quadratic Programming Algorithm with Applications in Model Predictive Controlcited by 4
  15. 2023An Improved Data Augmentation Scheme for Model Predictive Control Policy Approximationcited by 3
  16. 2023Error bounds for maxout neural network approximations of model predictive controlcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.