Global Deterministic Optimization with Artificial Neural Networks Embedded
Not on the map. Why?
Abstract (arXiv)
Artificial neural networks (ANNs) are used in various applications for data-driven black-box modeling and subsequent optimization. Herein, we present an efficient method for deterministic global optimization of ANN embedded optimization problems. The proposed method is based on relaxations of algorithms using McCormick relaxations in a reduced-space [textitSIOPT, 20 (2009), pp. 573-601] including the convex and concave envelopes of the nonlinear activation function of ANNs. The optimization problem is solved using our in-house global deterministic solver MAiNGO. The performance of the proposed method is shown in four optimization examples: an illustrative function, a fermentation process, a compressor plant and a chemical process optimization. The results show that computational solution time is favorable compared to the global general-purpose optimization solver BARON.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 9; 2023: 4; 2024: 4; 2025: 8; 2026: 3.
32 papers.
Sort:
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2022OMLT: Optimization & Machine Learning Toolkitcited by 34
- 2021Mixed-Integer Optimization with Constraint Learningcited by 30
- 2024Physics-Informed Neural Networks with Hard Linear Equality Constraintscited by 30
- 2021Optimization with Constraint Learning: A Framework and Surveycited by 28
- 2022Maximizing information from chemical engineering data sets: Applications to machine learningcited by 17
- 2022TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learningcited by 15
- 2025ENFORCE: Nonlinear Constrained Learning with Adaptive-depth Neural Projectioncited by 15
- 2022Learning from flowsheets: A generative transformer model for autocompletion of flowsheetscited by 10
- 2021Modeling Design and Control Problems Involving Neural Network Surrogatescited by 8
- 2022Counterfactual Explanations Using Optimization With Constraint Learningcited by 8
- 2023PySCIPOpt-ML: Embedding Trained Machine Learning Models into Mixed-Integer Programscited by 8
20 more
- 2022Graph Machine Learning for Design of High-Octane Fuelscited by 6
- 2022Modern Machine Learning Tools for Monitoring and Control of Industrial Processes: A Surveycited by 6
- 2024Machine learning for industrial sensing and control: A survey and practical perspectivecited by 6
- 2023Data-driven decision-focused surrogate modelingcited by 4
- 2025Deterministic Global Optimization of the Acquisition Function in Bayesian Optimization: To Do or Not To Do?cited by 3
- 2025An analysis of optimization problems involving ReLU neural networkscited by 2
- 2025Federated Learning from Molecules to Processes: A Perspectivecited by 2
- 2021Optimizing over an ensemble of neural networkscited by 1
- 2022Constraint Learning to Define Trust Regions in Predictive-Model Embedded Optimizationcited by 1
- 2022Digital Twin and Artificial Intelligence Incorporated With Surrogate Modeling for Hybrid and Sustainable Energy Systemscited by 1
- 2023Physics Informed Piecewise Linear Neural Networks for Process Optimizationcited by 1
- 2024Formulations and scalability of neural network surrogates in nonlinear optimization problemscited by 1
- 2025Nonlinear Optimization with GPU-Accelerated Neural Network Constraintscited by 1
- 2026Relaxation-Informed Training of Neural Network Surrogate Modelscited by 1
- 2024Tightening convex relaxations of trained neural networks: a unified approach for convex and S-shaped activationscited by 0
- 2025A physics-informed Bayesian optimization method for rapid development of electrical machinescited by 0
- 2025Optimization over Trained (and Sparse) Neural Networks: A Surrogate within a Surrogatecited by 0
- 2025Nonlinear Model Order Reduction of Dynamical Systems in Process Engineering: Review and Comparisoncited by 0
- 2026Data-Driven Conditional Flexibility Indexcited by 0
- 2026Representation Learning for Exact Preimagescited by 0
- 2026Representation Learning for Exact Preimages25 Sep 2026
- 2026Relaxation-Informed Training of Neural Network Surrogate Models24 Apr 2026
- 2026Data-Driven Conditional Flexibility Index22 Jan 2026
- 2025Nonlinear Optimization with GPU-Accelerated Neural Network Constraints26 Sep 2025
- 2025Federated Learning from Molecules to Processes: A Perspective23 Jun 2025
- 2025Nonlinear Model Order Reduction of Dynamical Systems in Process Engineering: Review and Comparison15 Jun 2025
- 2025Optimization over Trained (and Sparse) Neural Networks: A Surrogate within a Surrogate4 May 2025
- 2025Deterministic Global Optimization of the Acquisition Function in Bayesian Optimization: To Do or Not To Do?5 Mar 2025
- 2025A physics-informed Bayesian optimization method for rapid development of electrical machines1 Mar 2025
- 2025ENFORCE: Nonlinear Constrained Learning with Adaptive-depth Neural Projection10 Feb 2025
- 2025An analysis of optimization problems involving ReLU neural networks5 Feb 2025
- 2024Formulations and scalability of neural network surrogates in nonlinear optimization problems16 Dec 2024
20 more
- 2024Tightening convex relaxations of trained neural networks: a unified approach for convex and S-shaped activations30 Oct 2024
- 2024Physics-Informed Neural Networks with Hard Linear Equality Constraints11 Feb 2024
- 2024Machine learning for industrial sensing and control: A survey and practical perspective24 Jan 2024
- 2023PySCIPOpt-ML: Embedding Trained Machine Learning Models into Mixed-Integer Programs13 Dec 2023
- 2023Data-driven decision-focused surrogate modeling23 Aug 2023
- 2023When Deep Learning Meets Polyhedral Theory: A Survey29 Apr 2023
- 2023Physics Informed Piecewise Linear Neural Networks for Process Optimization2 Feb 2023
- 2022Digital Twin and Artificial Intelligence Incorporated With Surrogate Modeling for Hybrid and Sustainable Energy Systems30 Sep 2022
- 2022Modern Machine Learning Tools for Monitoring and Control of Industrial Processes: A Survey22 Sep 2022
- 2022Counterfactual Explanations Using Optimization With Constraint Learning22 Sep 2022
- 2022Learning from flowsheets: A generative transformer model for autocompletion of flowsheets1 Aug 2022
- 2022Graph Machine Learning for Design of High-Octane Fuels1 Jun 2022
- 2022TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learning30 Apr 2022
- 2022OMLT: Optimization & Machine Learning Toolkit4 Feb 2022
- 2022Maximizing information from chemical engineering data sets: Applications to machine learning25 Jan 2022
- 2022Constraint Learning to Define Trust Regions in Predictive-Model Embedded Optimization12 Jan 2022
- 2021Optimizing over an ensemble of neural networks13 Dec 2021
- 2021Modeling Design and Control Problems Involving Neural Network Surrogates20 Nov 2021
- 2021Mixed-Integer Optimization with Constraint Learning4 Nov 2021
- 2021Optimization with Constraint Learning: A Framework and Survey5 Oct 2021
- 2023When Deep Learning Meets Polyhedral Theory: A Surveycited by 39
- 2022OMLT: Optimization & Machine Learning Toolkitcited by 34
- 2021Mixed-Integer Optimization with Constraint Learningcited by 30
- 2024Physics-Informed Neural Networks with Hard Linear Equality Constraintscited by 30
- 2021Optimization with Constraint Learning: A Framework and Surveycited by 28
- 2022Maximizing information from chemical engineering data sets: Applications to machine learningcited by 17
- 2022TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learningcited by 15
- 2025ENFORCE: Nonlinear Constrained Learning with Adaptive-depth Neural Projectioncited by 15
- 2022Learning from flowsheets: A generative transformer model for autocompletion of flowsheetscited by 10
- 2021Modeling Design and Control Problems Involving Neural Network Surrogatescited by 8
- 2022Counterfactual Explanations Using Optimization With Constraint Learningcited by 8
- 2023PySCIPOpt-ML: Embedding Trained Machine Learning Models into Mixed-Integer Programscited by 8
12 most cited of 32 All 32 (JSON)
- 2026Representation Learning for Exact Preimages25 Sep 2026
- 2026Relaxation-Informed Training of Neural Network Surrogate Models24 Apr 2026
- 2026Data-Driven Conditional Flexibility Index22 Jan 2026
- 2025Nonlinear Optimization with GPU-Accelerated Neural Network Constraints26 Sep 2025
- 2025Federated Learning from Molecules to Processes: A Perspective23 Jun 2025
- 2025Nonlinear Model Order Reduction of Dynamical Systems in Process Engineering: Review and Comparison15 Jun 2025
- 2025Optimization over Trained (and Sparse) Neural Networks: A Surrogate within a Surrogate4 May 2025
- 2025Deterministic Global Optimization of the Acquisition Function in Bayesian Optimization: To Do or Not To Do?5 Mar 2025
- 2025A physics-informed Bayesian optimization method for rapid development of electrical machines1 Mar 2025
- 2025ENFORCE: Nonlinear Constrained Learning with Adaptive-depth Neural Projection10 Feb 2025
- 2025An analysis of optimization problems involving ReLU neural networks5 Feb 2025
- 2024Formulations and scalability of neural network surrogates in nonlinear optimization problems16 Dec 2024
12 newest of 32 All 32 (JSON)