Uncertainty quantification for deep learning-based schemes for solving high-dimensional backward stochastic differential equations
Not on the map. Why?
Abstract (arXiv)
Deep learning-based numerical schemes for solving high-dimensional backward stochastic differential equations (BSDEs) have recently raised plenty of scientific interest. While they enable numerical methods to approximate very high-dimensional BSDEs, their reliability has not been studied and is thus not understood. In this work, we study uncertainty quantification (UQ) for a class of deep learning-based BSDE schemes. More precisely, we review the sources of uncertainty involved in the schemes and numerically study the impact of different sources. Usually, the standard deviation (STD) of the approximate solutions obtained from multiple runs of the algorithm with different datasets is calculated to address the uncertainty. This approach is computationally quite expensive, especially for high-dimensional problems. Hence, we develop a UQ model that efficiently estimates the STD of the approximate solution using only a single run of the algorithm. The model also estimates the mean of the approximate solution, which can be leveraged to initialize the algorithm and improve the optimization process. Our numerical experiments show that the UQ model produces reliable estimates of the mean and STD of the approximate solution for the considered class of deep learning-based BSDE schemes. The estimated STD captures multiple sources of uncertainty, demonstrating its effectiveness in quantifying the uncertainty. Additionally, the model illustrates the improved performance when comparing different schemes based on the estimated STD values. Furthermore, it can identify hyperparameter values for which the scheme achieves good approximations.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 56 references that are in the map. First posted on arXiv 5 Oct 2023.
Builds on
24 of 56 references.
References · 24
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 819
- 2017Solving high-dimensional partial differential equations using deep learningcited by 556
- 2018To Trust Or Not To Trust A Classifiercited by 207
- 2017Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equationscited by 191
- 2018Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batchescited by 133
12 more
- 2019DropConnect Is Effective in Modeling Uncertainty of Bayesian Deep Networkscited by 92
- 2018Forward-Backward Stochastic Neural Networks: Deep Learning of High-dimensional Partial Differential Equationscited by 55
- 2019Deep splitting method for parabolic PDEscited by 53
- 2018Classification Uncertainty of Deep Neural Networks Based on Gradient Informationcited by 43
- 2018Convergence of the Deep BSDE Method for Coupled FBSDEscited by 43
- 2020Approximation error analysis of some deep backward schemes for nonlinear PDEscited by 21
- 2019Full error analysis for the training of deep neural networkscited by 17
- 2022UQGAN: A Unified Model for Uncertainty Quantification of Deep Classifiers trained via Conditional GANscited by 16
- 2021Convergence of the Deep BSDE method for FBSDEs with non-Lipschitz coefficientscited by 7
- 2020Deep learning algorithms for solving high dimensional nonlinear backward stochastic differential equationscited by 5
- 2020Strong overall error analysis for the training of artificial neural networks via random initializationscited by 4
- 2019Multistep schemes for solving backward stochastic differential equations on GPUcited by 2
Built on by
Citing papers per year: 2024: 1.
1 paper.