Ensuring DNN Solution Feasibility for Optimization Problems with Convex Constraints and Its Application to DC Optimal Power Flow Problems
Not on the map. Why?
Abstract (arXiv)
Ensuring solution feasibility is a key challenge in developing Deep Neural Network (DNN) schemes for solving constrained optimization problems, due to inherent DNN prediction errors. In this paper, we propose a ``preventive learning'' framework to guarantee DNN solution feasibility for problems with convex constraints and general objective functions without post-processing, upon satisfying a mild condition on constraint calibration. Without loss of generality, we focus on problems with only inequality constraints. We systematically calibrate inequality constraints used in DNN training, thereby anticipating prediction errors and ensuring the resulting solutions remain feasible. We characterize the calibration magnitudes and the DNN size sufficient for ensuring universal feasibility. We propose a new Adversarial-Sample Aware training algorithm to improve DNN's optimality performance without sacrificing feasibility guarantee. Overall, the framework provides two DNNs. The first one from characterizing the sufficient DNN size can guarantee universal feasibility while the other from the proposed training algorithm further improves optimality and maintains DNN's universal feasibility simultaneously. We apply the framework to develop DeepOPF+ for solving essential DC optimal power flow problems in grid operation. Simulation results over IEEE test cases show that it outperforms existing strong DNN baselines in ensuring 100% feasibility and attaining consistent optimality loss (<0.19%) and speedup (up to ×228) in both light-load and heavy-load regimes, as compared to a state-of-the-art solver. We also apply our framework to a non-convex problem and show its performance advantage over existing schemes.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 58 of its 109 references that are in the map. First posted on arXiv 15 Dec 2021.
Builds on
58 of 109 references.
References · 58
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2019Deep Equilibrium Modelscited by 603
- 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
- 2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 564
- 2020A Survey of Deep Active Learningcited by 547
- 2019Differentiable Convex Optimization Layerscited by 458
- 2017Smart "Predict, then Optimize"cited by 332
- 2018Adversarial Attacks and Defences: A Surveycited by 259
- 2018Melding the Data-Decisions Pipeline: Decision-Focused Learning for Combinatorial Optimizationcited by 220
- 2019Universal Approximation with Deep Narrow Networkscited by 198
- 2016Learning to Optimizecited by 195
38 more
- 2021DC3: A learning method for optimization with hard constraintscited by 181
- 2019SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solvercited by 173
- 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
- 2018A Dual Approach to Scalable Verification of Deep Networkscited by 125
- 2017Approximating Continuous Functions by ReLU Nets of Minimal Widthcited by 120
- 2017Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activationscited by 104
- 2020SoK: Certified Robustness for Deep Neural Networkscited by 100
- 2017Learning to Optimize: Training Deep Neural Networks for Wireless Resource Managementcited by 96
- 2019Predicting AC Optimal Power Flows: Combining Deep Learning and Lagrangian Dual Methodscited by 93
- 2020Adversarial Distributional Training for Robust Deep Learningcited by 79
- 2018Learning to Branchcited by 78
- 2019Deep Declarative Networks: A New Hopecited by 77
- 2019Learning Optimal Solutions for Extremely Fast AC Optimal Power Flowcited by 76
- 2019The Power Grid Library for Benchmarking AC Optimal Power Flow Algorithmscited by 63
- 2018Efficient representation and approximation of model predictive control laws via deep learningcited by 55
- 2021Physics-Informed Neural Networks for AC Optimal Power Flowcited by 52
- 2019DeepOPF: A Deep Neural Network Approach for Security-Constrained DC Optimal Power Flowcited by 50
- 2020DeepOPF: A Feasibility-Optimized Deep Neural Network Approach for AC Optimal Power Flow Problemscited by 45
- 2021Provable Repair of Deep Neural Networkscited by 39
- 2018Learning for Constrained Optimization: Identifying Optimal Active Constraint Setscited by 36
- 2019DeepOPF: Deep Neural Network for DC Optimal Power Flowcited by 32
- 2019Learning Warm-Start Points for AC Optimal Power Flowcited by 32
- 2019Learning for DC-OPF: Classifying active sets using neural netscited by 30
- 2020Learning Optimal Power Flow: Worst-Case Guarantees for Neural Networkscited by 28
- 2019Machine Learning for AC Optimal Power Flowcited by 24
- 2021Physics-Informed Neural Networks for Minimising Worst-Case Violations in DC Optimal Power Flowcited by 23
- 2018What game are we playing? End-to-end learning in normal and extensive form gamescited by 22
- 2021Learning Hard Optimization Problems: A Data Generation Perspectivecited by 21
- 2018Differentiable Submodular Maximizationcited by 19
- 2020Smart-PGSim: Using Neural Network to Accelerate AC-OPF Power Grid Simulationcited by 19
- 2021Neural Network Repair with Reachability Analysiscited by 19
- 2020Data-driven Optimal Power Flow: A Physics-Informed Machine Learning Approachcited by 18
- 2021DeepOPF-V: Solving AC-OPF Problems Efficientlycited by 18
- 2020A Convex Neural Network Solver for DCOPF with Generalization Guaranteescited by 17
- 2019Solutions of DC OPF are Never AC Feasiblecited by 16
- 2019Verification of Non-Linear Specifications for Neural Networkscited by 14
- 2020High-Fidelity Machine Learning Approximations of Large-Scale Optimal Power Flowcited by 13
- 2018Statistical Learning For DC Optimal Power Flowcited by 12
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 1.
6 papers.
- 2022Model-Based Deep Learning: On the Intersection of Deep Learning and Optimizationcited by 50
- 2023End-to-End Feasible Optimization Proxies for Large-Scale Economic Dispatchcited by 35
- 2022Topology-aware Graph Neural Networks for Learning Feasible and Adaptive ac-OPF Solutionscited by 28
- 2024GLinSAT: The General Linear Satisfiability Neural Network Layer By Accelerated Gradient Descentcited by 7
- 2022Model-Informed Generative Adversarial Network (MI-GAN) for Learning Optimal Power Flowcited by 2
- 2023AI Driven Near Real-time Locational Marginal Pricing Method: A Feasibility and Robustness Studycited by 0
- 2024GLinSAT: The General Linear Satisfiability Neural Network Layer By Accelerated Gradient Descent26 Sep 2024
- 2023AI Driven Near Real-time Locational Marginal Pricing Method: A Feasibility and Robustness Study16 Jun 2023
- 2023End-to-End Feasible Optimization Proxies for Large-Scale Economic Dispatch23 Apr 2023
- 2022Model-Informed Generative Adversarial Network (MI-GAN) for Learning Optimal Power Flow4 Jun 2022
- 2022Topology-aware Graph Neural Networks for Learning Feasible and Adaptive ac-OPF Solutions16 May 2022
- 2022Model-Based Deep Learning: On the Intersection of Deep Learning and Optimization5 May 2022