Variational Bayesian surrogate modelling with application to robust design optimisation
Not on the map. Why?
Abstract (arXiv)
Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current deterministic computational models are usually high-dimensional and uncertain. We consider Bayesian inference for constructing statistical surrogates with input uncertainties and intrinsic dimensionality reduction. The surrogate is trained by fitting to data obtained from a deterministic computational model. The assumed prior probability density of the surrogate is a Gaussian process. We determine the respective posterior probability density and parameters of the posited statistical model using variational Bayes. The non-Gaussian posterior is approximated by a Gaussian trial density with free variational parameters and the discrepancy between them is measured using the Kullback-Leibler (KL) divergence. We employ the stochastic gradient method to compute the variational parameters and other statistical model parameters by minimising the KL divergence. We demonstrate the accuracy and versatility of the proposed reduced dimension variational Gaussian process (RDVGP) surrogate on illustrative and robust structural optimisation problems where cost functions depend on a weighted sum of the mean and standard deviation of model outputs.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 78 references that are in the map. First posted on arXiv 23 Apr 2024.
Builds on
16 of 78 references.
References · 16
- 2016Variational Inference: A Review for Statisticianscited by 1,472
- 2019An Introduction to Variational Autoencoderscited by 1,000
- 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 609
- 2013Gaussian Processes for Big Datacited by 383
- 2020Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transformcited by 80
- 2022Bayesian Physics-Informed Neural Networks for real-world nonlinear dynamical systemscited by 54
- 2020Active Learning for Deep Gaussian Process Surrogatescited by 38
- 2020A Tutorial on Sparse Gaussian Processes and Variational Inferencecited by 31
- 2020A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observablescited by 29
- 2022Fully probabilistic deep models for forward and inverse problems in parametric PDEscited by 19
- 2020High-Dimensional Bayesian Optimization via Nested Riemannian Manifoldscited by 17
- 2023GP+: A Python Library for Kernel-based learning via Gaussian Processescited by 17
4 more
- 2019Modeling and Optimization with Gaussian Processes in Reduced Eigenbases -- Extended Versioncited by 8
- 2017Bayesian model and dimension reduction for uncertainty propagation: applications in random mediacited by 4
- 2020Bayesian learning of orthogonal embeddings for multi-fidelity Gaussian Processescited by 4
- 2023Stochastic PDE representation of random fields for large-scale Gaussian process regression and statistical finite element analysiscited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.