Deep neural network surrogates for non-smooth quantities of interest in shape uncertainty quantification
Not on the map. Why?
Abstract (arXiv)
We consider the point evaluation of the solution to interface problems with geometric uncertainties, where the uncertainty in the obstacle is described by a high-dimensional parameter boldsymboly∈[-1,1]d, d∈mathbbN. We focus in particular on an elliptic interface problem and a Helmholtz transmission problem. Point values of the solution in the physical domain depend in general non-smoothly on the high-dimensional parameter, posing a challenge when one is interested in building surrogates. Indeed, high-order methods show poor convergence rates, while methods which are able to track discontinuities usually suffer from the so-called curse of dimensionality. For this reason, in this work we propose to build surrogates for point evaluation using deep neural networks. We provide a theoretical justification for why we expect neural networks to provide good surrogates. Furthermore, we present extensive numerical experiments showing their good performance in practice. We observe in particular that neural networks do not suffer from the curse of dimensionality, and we study the dependence of the error on the number of point evaluations (that is, the number of discontinuities in the parameter space), as well as on several modeling parameters, such as the contrast between the two materials and, for the Helmholtz transmission problem, the wavenumber.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 76 references that are in the map. First posted on arXiv 18 Jan 2021.
Builds on
25 of 76 references.
References · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019DeepXDE: A deep learning library for solving differential equationscited by 617
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
- 2017Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equationscited by 362
- 2016On the Expressive Power of Deep Neural Networkscited by 302
- 2016Benefits of depth in neural networkscited by 248
- 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
- 2017Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equationscited by 188
- 2017Optimal approximation of piecewise smooth functions using deep ReLU neural networkscited by 176
- 2018Optimal approximation of continuous functions by very deep ReLU networkscited by 165
- 2019An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applicationscited by 118
13 more
- 2020A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEscited by 105
- 2019The phase diagram of approximation rates for deep neural networkscited by 86
- 2018Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantificationcited by 81
- 2019A Theoretical Analysis of Deep Neural Networks and Parametric PDEscited by 74
- 2018Deep Neural Networks Learn Non-Smooth Functions Effectivelycited by 57
- 2018A proof that artificial neural networks overcome the curse of dimensionality in the numerical approximation of Black-Scholes partial differential equationscited by 55
- 2019Nonlinear Approximation and (Deep) ReLU Networkscited by 45
- 2018Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black-Scholes Partial Differential Equationscited by 44
- 2018Data-driven discovery of PDEs in complex datasetscited by 42
- 2019Deep learning observables in computational fluid dynamicscited by 38
- 2020Physics Informed Neural Networks for Simulating Radiative Transfercited by 35
- 2018A proof that deep artificial neural networks overcome the curse of dimensionality in the numerical approximation of Kolmogorov partial differential equations with constant diffusion and nonlinear drift coefficientscited by 31
- 2020Numerical Solution of the Parametric Diffusion Equation by Deep Neural Networkscited by 27
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 1; 2025: 1.
4 papers.
- 2022Hyper-parameter tuning of physics-informed neural networks: Application to Helmholtz problemscited by 18
- 2024Learning smooth functions in high dimensions: from sparse polynomials to deep neural networkscited by 7
- 2022Physics-informed neural networks for operator equations with stochastic datacited by 1
- 2025Generalization Bounds for Equivariant Networks on Markov Datacited by 0
- 2025Generalization Bounds for Equivariant Networks on Markov Data1 Mar 2025
- 2024Learning smooth functions in high dimensions: from sparse polynomials to deep neural networks4 Apr 2024
- 2022Physics-informed neural networks for operator equations with stochastic data15 Nov 2022
- 2022Hyper-parameter tuning of physics-informed neural networks: Application to Helmholtz problems13 May 2022