Maximizing information from chemical engineering data sets: Applications to machine learning
Not on the map. Why?
Abstract (arXiv)
It is well-documented how artificial intelligence can have (and already is having) a big impact on chemical engineering. But classical machine learning approaches may be weak for many chemical engineering applications. This review discusses how challenging data characteristics arise in chemical engineering applications. We identify four characteristics of data arising in chemical engineering applications that make applying classical artificial intelligence approaches difficult: (1) high variance, low volume data, (2) low variance, high volume data, (3) noisy/corrupt/missing data, and (4) restricted data with physics-based limitations. For each of these four data characteristics, we discuss applications where these data characteristics arise and show how current chemical engineering research is extending the fields of data science and machine learning to incorporate these challenges. Finally, we identify several challenges for future research.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 35 of its 213 references that are in the map. First posted on arXiv 25 Jan 2022.
Builds on
35 of 213 references.
References · 35
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2018A Tutorial on Bayesian Optimizationcited by 734
- 2017Learning Sparse Neural Networks through L0 Regularizationcited by 571
- 2018Conditional Neural Processescited by 421
- 2018GAIN: Missing Data Imputation using Generative Adversarial Netscited by 349
- 2014Stochastic Gradient Hamiltonian Monte Carlocited by 341
- 2017Formal Verification of Piece-Wise Linear Feed-Forward Neural Networkscited by 241
- 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
- 2018Handling Incomplete Heterogeneous Data using VAEscited by 148
- 2017Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modelingcited by 130
- 2018Strong mixed-integer programming formulations for trained neural networkscited by 115
23 more
- 2017Maximum Resilience of Artificial Neural Networkscited by 97
- 2013Data-Driven Robust Optimizationcited by 84
- 2021Lyapunov-stable neural-network controlcited by 66
- 2015A General Framework for Constrained Bayesian Optimization using Information-based Searchcited by 50
- 2021Partition-based formulations for mixed-integer optimization of trained ReLU neural networkscited by 39
- 2018Global Deterministic Optimization with Artificial Neural Networks Embeddedcited by 32
- 2017Optimization of Tree Ensemblescited by 26
- 2019Improving Missing Data Imputation with Deep Generative Modelscited by 19
- 2019Stochastic data-driven model predictive control using Gaussian processescited by 19
- 2017The ALAMO approach to machine learningcited by 18
- 2018Mixed-Integer Convex Nonlinear Optimization with Gradient-Boosted Trees Embeddedcited by 16
- 2019Optimization under Uncertainty in the Era of Big Data and Deep Learning: When Machine Learning Meets Mathematical Programmingcited by 13
- 2020ENTMOOT: A Framework for Optimization over Ensemble Tree Modelscited by 13
- 2021Multi-Objective Constrained Optimization for Energy Applications via Tree Ensemblescited by 12
- 2020Distributionally Robust Chance Constrained Programming with Generative Adversarial Networks (GANs)cited by 4
- 2020A robust approach to warped Gaussian process-constrained optimizationcited by 4
- 2017Computer-aided molecular design: An introduction and review of tools, applications, and solution techniquescited by 3
- 2019Integrating production scheduling and process control using latent variable dynamic modelscited by 3
- 2020Data-Driven Robust Optimization using Unsupervised Deep Learningcited by 3
- 2017Data-Driven Stochastic Robust Optimization: A General Computational Framework and Algorithm for Optimization under Uncertainty in the Big Data Eracited by 2
- 2016Real-time Algorithm for Self-Reflective Model Predictive Controlcited by 1
- 2018Data-driven optimization of processes with degrading equipmentcited by 1
- 2018Some manifold learning considerations towards explicit model predictive controlcited by 1
Built on by
Citing papers per year: 2022: 4; 2023: 1; 2024: 3; 2025: 6; 2026: 3.
17 papers.
Sort:
- 2022OMLT: Optimization & Machine Learning Toolkitcited by 34
- 2022Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimizationcited by 16
- 2022SnAKe: Bayesian Optimization with Pathwise Explorationcited by 14
- 2022Tree ensemble kernels for Bayesian optimization with known constraints over mixed-feature spacescited by 14
- 2024Transition Constrained Bayesian Optimization via Markov Decision Processescited by 7
- 2026Artificial Intelligence in Materials Science and Engineering: Current Landscape, Key Challenges, and Future Trajectoriecited by 5
- 2024System-Aware Neural ODE Processes for Few-Shot Bayesian Optimizationcited by 3
- 2025Training Neural ODEs Using Fully Discretized Simultaneous Optimizationcited by 3
- 2025Global optimization of graph acquisition functions for neural architecture searchcited by 2
- 2025Federated Learning from Molecules to Processes: A Perspectivecited by 2
- 2025Survey and Tutorial of Reinforcement Learning Methods in Process Systems Engineeringcited by 2
- 2023Physics Informed Piecewise Linear Neural Networks for Process Optimizationcited by 1
5 more
- 2024A Hybrid Approach of Transfer Learning and Physics-Informed Modeling: Improving Dissolved Oxygen Concentration Prediction in an Industrial Wastewater Treatment Plantcited by 0
- 2025Efficient Training of Physics-enhanced Neural ODEs via Direct Collocation and Nonlinear Programmingcited by 0
- 20253W Dataset 2.0.0: a realistic and public dataset with rare undesirable real events in oil wellscited by 0
- 2026Meta-learning for sample-efficient Bayesian optimisation of fed-batch processescited by 0
- 2026Atoms to Processes: The Role of Artificial Intelligence and Machine Learning in Chemical Engineeringcited by 0
- 2026Atoms to Processes: The Role of Artificial Intelligence and Machine Learning in Chemical Engineering1 Oct 2026
- 2026Meta-learning for sample-efficient Bayesian optimisation of fed-batch processes6 May 2026
- 2026Artificial Intelligence in Materials Science and Engineering: Current Landscape, Key Challenges, and Future Trajectorie18 Jan 2026
- 2025Survey and Tutorial of Reinforcement Learning Methods in Process Systems Engineering28 Oct 2025
- 20253W Dataset 2.0.0: a realistic and public dataset with rare undesirable real events in oil wells25 Jun 2025
- 2025Federated Learning from Molecules to Processes: A Perspective23 Jun 2025
- 2025Global optimization of graph acquisition functions for neural architecture search29 May 2025
- 2025Efficient Training of Physics-enhanced Neural ODEs via Direct Collocation and Nonlinear Programming6 May 2025
- 2025Training Neural ODEs Using Fully Discretized Simultaneous Optimization21 Feb 2025
- 2024System-Aware Neural ODE Processes for Few-Shot Bayesian Optimization4 Jun 2024
- 2024Transition Constrained Bayesian Optimization via Markov Decision Processes13 Feb 2024
- 2024A Hybrid Approach of Transfer Learning and Physics-Informed Modeling: Improving Dissolved Oxygen Concentration Prediction in an Industrial Wastewater Treatment Plant20 Jan 2024
5 more
- 2023Physics Informed Piecewise Linear Neural Networks for Process Optimization2 Feb 2023
- 2022Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimization11 Nov 2022
- 2022Tree ensemble kernels for Bayesian optimization with known constraints over mixed-feature spaces2 Jul 2022
- 2022OMLT: Optimization & Machine Learning Toolkit4 Feb 2022
- 2022SnAKe: Bayesian Optimization with Pathwise Exploration31 Jan 2022
- 2022OMLT: Optimization & Machine Learning Toolkitcited by 34
- 2022Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimizationcited by 16
- 2022SnAKe: Bayesian Optimization with Pathwise Explorationcited by 14
- 2022Tree ensemble kernels for Bayesian optimization with known constraints over mixed-feature spacescited by 14
- 2024Transition Constrained Bayesian Optimization via Markov Decision Processescited by 7
- 2026Artificial Intelligence in Materials Science and Engineering: Current Landscape, Key Challenges, and Future Trajectoriecited by 5
- 2024System-Aware Neural ODE Processes for Few-Shot Bayesian Optimizationcited by 3
- 2025Training Neural ODEs Using Fully Discretized Simultaneous Optimizationcited by 3
- 2025Global optimization of graph acquisition functions for neural architecture searchcited by 2
- 2025Federated Learning from Molecules to Processes: A Perspectivecited by 2
- 2025Survey and Tutorial of Reinforcement Learning Methods in Process Systems Engineeringcited by 2
- 2023Physics Informed Piecewise Linear Neural Networks for Process Optimizationcited by 1
12 most cited of 17 All 17 (JSON)
- 2026Atoms to Processes: The Role of Artificial Intelligence and Machine Learning in Chemical Engineering1 Oct 2026
- 2026Meta-learning for sample-efficient Bayesian optimisation of fed-batch processes6 May 2026
- 2026Artificial Intelligence in Materials Science and Engineering: Current Landscape, Key Challenges, and Future Trajectorie18 Jan 2026
- 2025Survey and Tutorial of Reinforcement Learning Methods in Process Systems Engineering28 Oct 2025
- 20253W Dataset 2.0.0: a realistic and public dataset with rare undesirable real events in oil wells25 Jun 2025
- 2025Federated Learning from Molecules to Processes: A Perspective23 Jun 2025
- 2025Global optimization of graph acquisition functions for neural architecture search29 May 2025
- 2025Efficient Training of Physics-enhanced Neural ODEs via Direct Collocation and Nonlinear Programming6 May 2025
- 2025Training Neural ODEs Using Fully Discretized Simultaneous Optimization21 Feb 2025
- 2024System-Aware Neural ODE Processes for Few-Shot Bayesian Optimization4 Jun 2024
- 2024Transition Constrained Bayesian Optimization via Markov Decision Processes13 Feb 2024
- 2024A Hybrid Approach of Transfer Learning and Physics-Informed Modeling: Improving Dissolved Oxygen Concentration Prediction in an Industrial Wastewater Treatment Plant20 Jan 2024
12 newest of 17 All 17 (JSON)