mlsanityData to 7 Oct 2026

Gradient-enhanced deep Gaussian processes for multifidelity modelling

arXiv 2402.16059 ↗First posted 25 Feb 2024stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multifidelity models integrate data from multiple sources to produce a single approximator for the underlying process. Dense low-fidelity samples are used to reduce interpolation error, while sparse high-fidelity samples are used to compensate for bias or noise in the low-fidelity samples. Deep Gaussian processes (GPs) are attractive for multifidelity modelling as they are non-parametric, robust to overfitting, perform well for small datasets, and, critically, can capture nonlinear and input-dependent relationships between data of different fidelities. Many datasets naturally contain gradient data, especially when they are generated by computational models that are compatible with automatic differentiation or have adjoint solutions. Principally, this work extends deep GPs to incorporate gradient data. We demonstrate this method on an analytical test problem and a realistic partial differential equation problem, where we predict the aerodynamic coefficients of a hypersonic flight vehicle over a range of flight conditions and geometries. In both examples, the gradient-enhanced deep GP outperforms a gradient-enhanced linear GP model and their non-gradient-enhanced counterparts.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 43 references that are in the map. First posted on arXiv 25 Feb 2024.

Builds on

13 of 43 references.

References · 13

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2015Automatic differentiation in machine learning: a surveycited by 846
  3. 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 603
  4. 2017Doubly Stochastic Variational Inference for Deep Gaussian Processescited by 143
  5. 2018Survey of multifidelity methods in uncertainty propagation, inference, and optimizationcited by 141
  6. 2015Gaussian Processes for Data-Efficient Learning in Robotics and Controlcited by 97
  7. 2019Deep Gaussian Processes for Multi-fidelity Modelingcited by 48
  8. 2020Overview of Gaussian process based multi-fidelity techniques with variable relationship between fidelitiescited by 24
  9. 2019Bayesian Optimization using Deep Gaussian Processescited by 22
  10. 2020Deep Sigma Point Processescited by 16
  11. 2017Gradient-enhanced kriging for high-dimensional problemscited by 15
  12. 2021Scaling Gaussian Processes with Derivative Information Using Variational Inferencecited by 15
1 more
  1. 2014Gaussian Process Volatility Modelcited by 7

Built on by

Not cited yet.