# A supermartingale approach to Gaussian process based sequential design of experiments

arXiv: https://arxiv.org/abs/1608.01118 · HTML: https://mlsanity.com/paper/1608.01118/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Aug 2016.

## Built on by (most cited first, 20 of 20)

- [Bayesian Optimization of Function Networks](https://mlsanity.com/paper/2112.15311/) (2021)
- [Constrained Bayesian Optimization Under Partial Observations: Balanced Improvements and Provable Convergence](https://mlsanity.com/paper/2312.03212/) (2023)
- [Collaborative Bayesian Optimization via Wasserstein Barycenters](https://mlsanity.com/paper/2504.10770/) (2025)
- [Gaussian Processes on Distributions based on Regularized Optimal Transport](https://mlsanity.com/paper/2210.06574/) (2022)
- [Knowledge Gradient for Multi-Objective Bayesian Optimization with Decoupled Evaluations](https://mlsanity.com/paper/2302.01310/) (2023)
- [Robust expected improvement for Bayesian optimization](https://mlsanity.com/paper/2302.08612/) (2023)
- [Pseudo-Bayesian Optimization](https://mlsanity.com/paper/2310.09766/) (2023)
- [On the convergence rate of noisy Bayesian Optimization with Expected Improvement](https://mlsanity.com/paper/2501.09262/) (2025)
- [Uncertainty Quantification and Experimental Design for Large-Scale Linear Inverse Problems under Gaussian Process Priors](https://mlsanity.com/paper/2109.03457/) (2021)
- [Bayesian sequential design of computer experiments for quantile set inversion](https://mlsanity.com/paper/2211.01008/) (2022)
- [Practical Bayesian Algorithm Execution via Posterior Sampling](https://mlsanity.com/paper/2410.20596/) (2024)
- [CRPS-Based Targeted Sequential Design with Application in Chemical Space](https://mlsanity.com/paper/2503.11250/) (2025)
- [Goal-oriented adaptive sampling under random field modelling of response probability distributions](https://mlsanity.com/paper/2102.07612/) (2021)
- [Consistency of some sequential experimental design strategies for excursion set estimation based on vector-valued Gaussian processes](https://mlsanity.com/paper/2310.07315/) (2023)
- [Bayesian Optimization for Non-Convex Two-Stage Stochastic Optimization Problems](https://mlsanity.com/paper/2408.17387/) (2024)
- [The Label Defines the Timescale: Trait-State Limits of Temporal-Aggregate Learning](https://mlsanity.com/paper/2608.01587/) (2026)
- [Epidemiological Model Calibration via Graybox Bayesian Optimization](https://mlsanity.com/paper/2412.07193/) (2024)
- [An (ε,δ)-accurate level set estimation with a stopping criterion](https://mlsanity.com/paper/2503.20272/) (2025)
- [Bayesian Active Learning of (small) Quantile Sets through Expected Estimator Modification](https://mlsanity.com/paper/2506.13211/) (2025)
- [Expected Hypervolume Maximization for Multiobjective Optimization under Uncertainties](https://mlsanity.com/paper/2609.19858/) (2026)

## Abstract (arXiv)

Gaussian process (GP) models have become a well-established frameworkfor the adaptive design of costly experiments, and notably of computerexperiments. GP-based sequential designs have been found practicallyefficient for various objectives, such as global optimization(estimating the global maximum or maximizer(s) of a function),reliability analysis (estimating a probability of failure) or theestimation of level sets and excursion sets. In this paper, we studythe consistency of an important class of sequential designs, known asstepwise uncertainty reduction (SUR) strategies. Our approach relieson the key observation that the sequence of residual uncertaintymeasures, in SUR strategies, is generally a supermartingale withrespect to the filtration generated by the observations. Thisobservation enables us to establish generic consistency results for abroad class of SUR strategies. The consistency of several popularsequential design strategies is then obtained by means of this generalresult. Notably, we establish the consistency of two SUR strategiesproposed by Bect, Ginsbourger, Li, Picheny and Vazquez (Stat. Comp.,2012)---to the best of our knowledge, these are the first proofs ofconsistency for GP-based sequential design algorithms dedicated to theestimation of excursion sets and their measure. We also establish anew, more general proof of consistency for the expected improvementalgorithm for global optimization which, unlike previous results inthe literature, applies to any GP with continuous sample paths.