mlsanityData to 7 Oct 2026

Multifidelity Cross-validation

arXiv 2407.01495 ↗First posted 1 Jul 2024stat.CO stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Emulating the mapping between quantities of interest and their control parameters using surrogate models finds widespread application in engineering design, including in numerical optimization and uncertainty quantification. Gaussian process models can serve as a probabilistic surrogate model of unknown functions, thereby making them highly suitable for engineering design and decision-making in the presence of uncertainty. In this work, we are interested in emulating quantities of interest observed from models of a system at multiple fidelities, which trade accuracy for computational efficiency. Using multifidelity Gaussian process models, to efficiently fuse models at multiple fidelities, we propose a novel method to actively learn the surrogate model via leave-one-out cross-validation (LOO-CV). Our proposed multifidelity cross-validation (textttMFCV) approach develops an adaptive approach to reduce the LOO-CV error at the target (highest) fidelity, by learning the correlations between the LOO-CV at all fidelities. textttMFCV develops a two-step lookahead policy to select optimal input-fidelity pairs, both in sequence and in batches, both for continuous and discrete fidelity spaces. We demonstrate the utility of our method on several synthetic test problems as well as on the thermal stress analysis of a gas turbine blade.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 63 references that are in the map. First posted on arXiv 1 Jul 2024.

Builds on

14 of 63 references.

References · 14

  1. 2016Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasetscited by 131
  2. 2017Multi-fidelity Bayesian Optimisation with Continuous Approximationscited by 120
  3. 2016Multi-Information Source Optimizationcited by 83
  4. 2016Practical heteroskedastic Gaussian process modeling for large simulation experimentscited by 38
  5. 2017Replication or exploration? Sequential design for stochastic simulation experimentscited by 28
  6. 2019BoTorch: A Framework for Efficient Monte-Carlo Bayesian Optimizationcited by 28
  7. 2019Multi-fidelity Bayesian Optimization with Max-value Entropy Search and its parallelizationcited by 19
  8. 2020Enhanced data efficiency using deep neural networks and Gaussian processes for aerodynamic design optimizationcited by 15
  9. 2023qPOTS: Efficient batch multiobjective Bayesian optimization via Pareto optimal Thompson samplingcited by 11
  10. 2018Contour location via entropy reduction leveraging multiple information sourcescited by 10
  11. 2021Entropy-based adaptive design for contour finding and estimating reliabilitycited by 10
  12. 2023Contour Location for Reliability in Airfoil Simulation Experiments using Deep Gaussian Processescited by 7
2 more
  1. 2021Lookahead Acquisition Functions for Finite-Horizon Time-Dependent Bayesian Optimization and Application to Quantum Optimal Controlcited by 6
  2. 2021Data-Driven Wind Turbine Wake Modeling via Probabilistic Machine Learningcited by 2

Built on by

Not cited yet.