# A hierarchical expected improvement method for Bayesian optimization

arXiv: https://arxiv.org/abs/1911.07285 · HTML: https://mlsanity.com/paper/1911.07285/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 17 Nov 2019.

## Built on by (most cited first, 13 of 13)

- [Additive Multi-Index Gaussian process modeling, with application to multi-physics surrogate modeling of the quark-gluon plasma](https://mlsanity.com/paper/2306.07299/) (2023)
- [An Augmented Surprise-guided Sequential Learning Framework for Predicting the Melt Pool Geometry](https://mlsanity.com/paper/2401.05579/) (2024)
- [How Bayesian Should Bayesian Optimisation Be?](https://mlsanity.com/paper/2105.00894/) (2021)
- [Towards Futuristic Autonomous Experimentation--A Surprise-Reacting Sequential Experiment Policy](https://mlsanity.com/paper/2112.00600/) (2021)
- [Accelerating material discovery with a threshold-driven hybrid acquisition policy-based Bayesian optimization](https://mlsanity.com/paper/2311.09591/) (2023)
- [Expected Diverse Utility (EDU): Diverse Bayesian Optimization of Expensive Computer Simulators](https://mlsanity.com/paper/2410.01196/) (2024)
- [Dynamic Exploration-Exploitation Trade-Off in Active Learning Regression with Bayesian Hierarchical Modeling](https://mlsanity.com/paper/2304.07665/) (2023)
- [Trigonometric Quadrature Fourier Features for Scalable Gaussian Process Regression](https://mlsanity.com/paper/2310.14544/) (2023)
- [Targeted Variance Reduction: Robust Bayesian Optimization of Black-Box Simulators with Noise Parameters](https://mlsanity.com/paper/2403.03816/) (2024)
- [Efficient optimization of expensive black-box simulators via marginal means, with application to neutrino detector design](https://mlsanity.com/paper/2508.01834/) (2025)
- [Segmentation, Classification and Interpretation of Breast Cancer Medical Images using Human-in-the-Loop Machine Learning](https://mlsanity.com/paper/2403.20112/) (2024)
- [Local transfer learning Gaussian process modeling, with applications to surrogate modeling of expensive computer simulators](https://mlsanity.com/paper/2410.12690/) (2024)
- [Fast and Provably Accurate Sequential Designs using Hilbert Space Gaussian Processes](https://mlsanity.com/paper/2604.20414/) (2026)

## Abstract (arXiv)

The Expected Improvement (EI) method, proposed by Jones et al. (1998), is a widely-used Bayesian optimization method, which makes use of a fitted Gaussian process model for efficient black-box optimization. However, one key drawback of EI is that it is overly greedy in exploiting the fitted Gaussian process model for optimization, which results in suboptimal solutions even with large sample sizes. To address this, we propose a new hierarchical EI (HEI) framework, which makes use of a hierarchical Gaussian process model. HEI preserves a closed-form acquisition function, and corrects the over-greediness of EI by encouraging exploration of the optimization space. We then introduce hyperparameter estimation methods which allow HEI to mimic a fully Bayesian optimization procedure, while avoiding expensive Markov-chain Monte Carlo sampling steps. We prove the global convergence of HEI over a broad function space, and establish near-minimax convergence rates under certain prior specifications. Numerical experiments show the improvement of HEI over existing Bayesian optimization methods, for synthetic functions and a semiconductor manufacturing optimization problem.