mlsanityData to 7 Oct 2026

Ensuring DNN Solution Feasibility for Optimization Problems with Convex Constraints and Its Application to DC Optimal Power Flow Problems

arXiv 2112.08091 ↗First posted 15 Dec 2021cs.LG cs.SY eess.SYcited by 6

Not on the map. Why?

Abstract (arXiv)

Ensuring solution feasibility is a key challenge in developing Deep Neural Network (DNN) schemes for solving constrained optimization problems, due to inherent DNN prediction errors. In this paper, we propose a ``preventive learning'' framework to guarantee DNN solution feasibility for problems with convex constraints and general objective functions without post-processing, upon satisfying a mild condition on constraint calibration. Without loss of generality, we focus on problems with only inequality constraints. We systematically calibrate inequality constraints used in DNN training, thereby anticipating prediction errors and ensuring the resulting solutions remain feasible. We characterize the calibration magnitudes and the DNN size sufficient for ensuring universal feasibility. We propose a new Adversarial-Sample Aware training algorithm to improve DNN's optimality performance without sacrificing feasibility guarantee. Overall, the framework provides two DNNs. The first one from characterizing the sufficient DNN size can guarantee universal feasibility while the other from the proposed training algorithm further improves optimality and maintains DNN's universal feasibility simultaneously. We apply the framework to develop DeepOPF+ for solving essential DC optimal power flow problems in grid operation. Simulation results over IEEE test cases show that it outperforms existing strong DNN baselines in ensuring 100% feasibility and attaining consistent optimality loss (<0.19%) and speedup (up to ×228) in both light-load and heavy-load regimes, as compared to a state-of-the-art solver. We also apply our framework to a non-convex problem and show its performance advantage over existing schemes.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 58 of its 109 references that are in the map. First posted on arXiv 15 Dec 2021.

Builds on

58 of 109 references.

References · 58

  1. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  2. 2018Neural Ordinary Differential Equationscited by 3,733
  3. 2019Deep Equilibrium Modelscited by 603
  4. 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
  5. 2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 564
  6. 2020A Survey of Deep Active Learningcited by 547
  7. 2019Differentiable Convex Optimization Layerscited by 458
  8. 2017Smart "Predict, then Optimize"cited by 332
  9. 2018Adversarial Attacks and Defences: A Surveycited by 259
  10. 2018Melding the Data-Decisions Pipeline: Decision-Focused Learning for Combinatorial Optimizationcited by 220
  11. 2019Universal Approximation with Deep Narrow Networkscited by 198
  12. 2016Learning to Optimizecited by 195
38 more
  1. 2021DC3: A learning method for optimization with hard constraintscited by 181
  2. 2019SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solvercited by 173
  3. 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
  4. 2018A Dual Approach to Scalable Verification of Deep Networkscited by 125
  5. 2017Approximating Continuous Functions by ReLU Nets of Minimal Widthcited by 120
  6. 2017Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activationscited by 104
  7. 2020SoK: Certified Robustness for Deep Neural Networkscited by 100
  8. 2017Learning to Optimize: Training Deep Neural Networks for Wireless Resource Managementcited by 96
  9. 2019Predicting AC Optimal Power Flows: Combining Deep Learning and Lagrangian Dual Methodscited by 93
  10. 2020Adversarial Distributional Training for Robust Deep Learningcited by 79
  11. 2018Learning to Branchcited by 78
  12. 2019Deep Declarative Networks: A New Hopecited by 77
  13. 2019Learning Optimal Solutions for Extremely Fast AC Optimal Power Flowcited by 76
  14. 2019The Power Grid Library for Benchmarking AC Optimal Power Flow Algorithmscited by 63
  15. 2018Efficient representation and approximation of model predictive control laws via deep learningcited by 55
  16. 2021Physics-Informed Neural Networks for AC Optimal Power Flowcited by 52
  17. 2019DeepOPF: A Deep Neural Network Approach for Security-Constrained DC Optimal Power Flowcited by 50
  18. 2020DeepOPF: A Feasibility-Optimized Deep Neural Network Approach for AC Optimal Power Flow Problemscited by 45
  19. 2021Provable Repair of Deep Neural Networkscited by 39
  20. 2018Learning for Constrained Optimization: Identifying Optimal Active Constraint Setscited by 36
  21. 2019DeepOPF: Deep Neural Network for DC Optimal Power Flowcited by 32
  22. 2019Learning Warm-Start Points for AC Optimal Power Flowcited by 32
  23. 2019Learning for DC-OPF: Classifying active sets using neural netscited by 30
  24. 2020Learning Optimal Power Flow: Worst-Case Guarantees for Neural Networkscited by 28
  25. 2019Machine Learning for AC Optimal Power Flowcited by 24
  26. 2021Physics-Informed Neural Networks for Minimising Worst-Case Violations in DC Optimal Power Flowcited by 23
  27. 2018What game are we playing? End-to-end learning in normal and extensive form gamescited by 22
  28. 2021Learning Hard Optimization Problems: A Data Generation Perspectivecited by 21
  29. 2018Differentiable Submodular Maximizationcited by 19
  30. 2020Smart-PGSim: Using Neural Network to Accelerate AC-OPF Power Grid Simulationcited by 19
  31. 2021Neural Network Repair with Reachability Analysiscited by 19
  32. 2020Data-driven Optimal Power Flow: A Physics-Informed Machine Learning Approachcited by 18
  33. 2021DeepOPF-V: Solving AC-OPF Problems Efficientlycited by 18
  34. 2020A Convex Neural Network Solver for DCOPF with Generalization Guaranteescited by 17
  35. 2019Solutions of DC OPF are Never AC Feasiblecited by 16
  36. 2019Verification of Non-Linear Specifications for Neural Networkscited by 14
  37. 2020High-Fidelity Machine Learning Approximations of Large-Scale Optimal Power Flowcited by 13
  38. 2018Statistical Learning For DC Optimal Power Flowcited by 12

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 2; 2024: 1.

6 papers.