# A Deep Neural Network Surrogate for High-Dimensional Random Partial Differential Equations

arXiv: https://arxiv.org/abs/1806.02957 · HTML: https://mlsanity.com/paper/1806.02957/

## Key facts

- Cited by 23 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 8 Jun 2018.

## Built on by (most cited first, 23 of 23)

- [Solving PDE-constrained Control Problems Using Operator Learning](https://mlsanity.com/paper/2111.04941/) (2021)
- [PI-VAE: Physics-Informed Variational Auto-Encoder for stochastic differential equations](https://mlsanity.com/paper/2203.11363/) (2022)
- [An Extreme Learning Machine-Based Method for Computational PDEs in Higher Dimensions](https://mlsanity.com/paper/2309.07049/) (2023)
- [A Deep Collocation Method for the Bending Analysis of Kirchhoff Plate](https://mlsanity.com/paper/2102.02617/) (2021)
- [MultiAuto-DeepONet: A Multi-resolution Autoencoder DeepONet for Nonlinear Dimension Reduction, Uncertainty Quantification and Operator Learning of Forward and Inverse Stochastic Problems](https://mlsanity.com/paper/2204.03193/) (2022)
- [Full error analysis of the random deep splitting method for nonlinear parabolic PDEs and PIDEs](https://mlsanity.com/paper/2405.05192/) (2024)
- [Quantum Quantile Mechanics: Solving Stochastic Differential Equations for Generating Time-Series](https://mlsanity.com/paper/2108.03190/) (2021)
- [Hybrid Neural Autoencoders for Stimulus Encoding in Visual and Other Sensory Neuroprostheses](https://mlsanity.com/paper/2205.13623/) (2022)
- [Pseudo-Differential Neural Operator: Generalized Fourier Neural Operator for Learning Solution Operators of Partial Differential Equations](https://mlsanity.com/paper/2201.11967/) (2022)
- [Neural Control of Parametric Solutions for High-dimensional Evolution PDEs](https://mlsanity.com/paper/2302.00045/) (2023)
- [Approximating High-Dimensional Minimal Surfaces with Physics-Informed Neural Networks](https://mlsanity.com/paper/2309.02589/) (2023)
- [Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media](https://mlsanity.com/paper/2405.19019/) (2024)
- [Computing the Invariant Distribution of Randomly Perturbed Dynamical Systems Using Deep Learning](https://mlsanity.com/paper/2110.11538/) (2021)
- [LSA-PINN: Linear Boundary Connectivity Loss for Solving PDEs on Complex Geometry](https://mlsanity.com/paper/2302.01518/) (2023)
- [Demystifying the Data Need of ML-surrogates for CFD Simulations](https://mlsanity.com/paper/2205.08355/) (2022)
- [Robust Topology Optimization Using Multi-Fidelity Variational Autoencoders](https://mlsanity.com/paper/2107.10661/) (2021)
- [Uncertainty Quantification for Transport in Porous media using Parameterized Physics Informed neural Networks](https://mlsanity.com/paper/2205.12730/) (2022)
- [Predicting the spread of COVID-19 in Delhi, India using Deep Residual Recurrent Neural Networks](https://mlsanity.com/paper/2110.05477/) (2021)
- [Bayesian deep learning framework for uncertainty quantification in high dimensions](https://mlsanity.com/paper/2210.11737/) (2022)
- [Approximation of Solution Operators for High-dimensional PDEs](https://mlsanity.com/paper/2401.10385/) (2024)
- [Predicting Wall Thickness Changes in Cold Forging Processes: An Integrated FEM and Neural Network approach](https://mlsanity.com/paper/2411.13366/) (2024)
- [Optimization Landscapes Learned: Proxy Networks Boost Convergence in Physics-based Inverse Problems](https://mlsanity.com/paper/2501.16573/) (2025)
- [Physics-Informed Neural Network Frameworks for the Analysis of Engineering and Biological Dynamical Systems Governed by Ordinary Differential Equations](https://mlsanity.com/paper/2511.00043/) (2025)

## Abstract (arXiv)

Developing efficient numerical algorithms for the solution of high dimensional random Partial Differential Equations (PDEs) has been a challenging task due to the well-known curse of dimensionality. We present a new solution framework for these problems based on a deep learning approach. Specifically, the random PDE is approximated by a feed-forward fully-connected deep residual network, with either strong or weak enforcement of initial and boundary constraints. The framework is mesh-free, and can handle irregular computational domains. Parameters of the approximating deep neural network are determined iteratively using variants of the Stochastic Gradient Descent (SGD) algorithm. The satisfactory accuracy of the proposed frameworks is numerically demonstrated on diffusion and heat conduction problems, in comparison with the converged Monte Carlo-based finite element results.