Multi-Variable Batch Bayesian Optimization in Materials Research: Synthetic Data Analysis of Noise Sensitivity and Problem Landscape Effects
Not on the map. Why?
Abstract (arXiv)
Bayesian Optimization (BO) machine learning method is increasingly used to guide experimental optimization tasks in materials science. To emulate the large number of input variables and noise-containing results in experimental materials research, we perform batch BO simulation of six design variables with a range of noise levels. Two test cases relevant for materials science problems are examined: a needle-in-a-haystack case (Ackley function) that may be encountered in, e.g., molecule optimizations, and a smooth landscape with a local optimum in addition to the global optimum (Hartmann function) that may be encountered in, e.g., material composition optimization. We show learning curves, performance metrics, and visualization to effectively track the optimization progression and evaluate how the optimization outcomes are affected by noise, batch-picking method, choice of acquisition function, and exploration hyperparameter values. We find that the effects of noise depend on the problem landscape: noise degrades the optimization results of a needle-in-a-haystack search (Ackley) dramatically more. However, with increasing noise, we observe an increasing probability of landing on the local optimum in Hartmann. Therefore, prior knowledge of the problem domain structure and noise level is essential when designing BO for materials research experiments. Synthetic data studies -- with known ground truth and controlled noise levels -- enable us to isolate and evaluate the impact of different batch BO components, it e.g., acquisition policy, objective metrics, and hyperparameter values, before transitioning to the inherent uncertainties of real experimental systems. The results and methodology of this study will facilitate a greater utilization of BO in guiding experimental materials research, specifically in settings with a large number of design variables to optimize.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 62 references that are in the map. First posted on arXiv 4 Apr 2025.
Builds on
18 of 62 references.
References · 18
- 2018A Tutorial on Bayesian Optimizationcited by 744
- 2019Scalable Global Optimization via Local Bayesian Optimizationcited by 374
- 2023Unexpected Improvements to Expected Improvement for Bayesian Optimizationcited by 149
- 2015Batch Bayesian Optimization via Local Penalizationcited by 104
- 2017Constrained Bayesian Optimization with Noisy Experimentscited by 104
- 2022Recent Advances in Bayesian Optimizationcited by 76
- 2023A Study of Bayesian Neural Network Surrogates for Bayesian Optimizationcited by 50
- 2021Benchmarking the Performance of Bayesian Optimization across Multiple Experimental Materials Science Domainscited by 48
- 2022Robust Multi-Objective Bayesian Optimization Under Input Noisecited by 37
- 2021TREGO: a Trust-Region Framework for Efficient Global Optimizationcited by 29
- 2021Emulation of physical processes with Emukitcited by 24
- 2020Autonomous Materials Discovery Driven by Gaussian Process Regression with Inhomogeneous Measurement Noise and Anisotropic Kernelscited by 17
6 more
- 2022Fast Bayesian Optimization of Needle-in-a-Haystack Problems using Zooming Memory-Based Initialization (ZoMBI)cited by 14
- 2019On Batch Bayesian Optimizationcited by 12
- 2021Machine Learning with Knowledge Constraints for Process Optimization of Open-Air Perovskite Solar Cell Manufacturingcited by 8
- 2022Investigating Bayesian optimization for expensive-to-evaluate black box functions: Application in fluid dynamicscited by 6
- 2018Efficient and Scalable Batch Bayesian Optimization Using K-Meanscited by 5
- 2023A Corrected Expected Improvement Acquisition Function Under Noisy Observationscited by 5
Built on by
Not cited yet.