An overview on deep learning-based approximation methods for partial differential equations
Not on the map. Why?
Abstract (arXiv)
It is one of the most challenging problems in applied mathematics to approximatively solve high-dimensional partial differential equations (PDEs). Recently, several deep learning-based approximation algorithms for attacking this problem have been proposed and tested numerically on a number of examples of high-dimensional PDEs. This has given rise to a lively field of research in which deep learning-based methods and related Monte Carlo methods are applied to the approximation of high-dimensional PDEs. In this article we offer an introduction to this field of research by revisiting selected mathematical results related to deep learning approximation methods for PDEs and reviewing the main ideas of their proofs. We also provide a short overview of the recent literature in this area of research.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 13; 2023: 17; 2024: 12; 2025: 11; 2026: 6.
65 papers.
Sort:
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2024ConFIG: Towards Conflict-free Training of Physics Informed Neural Networkscited by 43
- 2021Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neuronscited by 41
- 2021Random feature neural networks learn Black-Scholes type PDEs without curse of dimensionalitycited by 34
- 2023Advances in machine-learning-based sampling motivated by lattice quantum chromodynamicscited by 23
- 2021Interpolating between BSDEs and PINNs: deep learning for elliptic and parabolic boundary value problemscited by 21
- 2022Mean-field neural networks: learning mappings on Wasserstein spacecited by 15
- 2021Error Estimates for the Deep Ritz Method with Boundary Penaltycited by 14
- 2024Full error analysis of the random deep splitting method for nonlinear parabolic PDEs and PIDEscited by 12
- 2022Convergence of a robust deep FBSDE method for stochastic controlcited by 11
- 2022DOSnet as a Non-Black-Box PDE Solver: When Deep Learning Meets Operator Splittingcited by 11
- 2023Achieving High Accuracy with PINNs via Energy Natural Gradientscited by 10
38 more
- 2023Global Convergence of Deep Galerkin and PINNs Methods for Solving Partial Differential Equationscited by 10
- 2022Deep neural network expressivity for optimal stopping problemscited by 9
- 2022Mean-field neural networks-based algorithms for McKean-Vlasov control problems *cited by 9
- 2023Multilevel CNNs for Parametric PDEscited by 9
- 2022Neural Q-learning for solving PDEscited by 8
- 2021Distributional Offline Continuous-Time Reinforcement Learning with Neural Physics-Informed PDEs (SciPhy RL for DOCTR-L)cited by 6
- 2021Physics-informed attention-based neural network for solving non-linear partial differential equationscited by 6
- 2022Jensen-Shannon Divergence Based Novel Loss Functions for Bayesian Neural Networkscited by 6
- 2025Non-convergence to the optimal risk for Adam and stochastic gradient descent optimization in the training of deep neural networkscited by 6
- 2022Pricing options on flow forwards by neural networks in Hilbert spacecited by 5
- 2023From continuous-time formulations to discretization schemes: tensor trains and robust regression for BSDEs and parabolic PDEscited by 5
- 2025A brief review of the Deep BSDE method for solving high-dimensional partial differential equationscited by 5
- 2022Temporal Difference Learning with Continuous Time and State in the Stochastic Settingcited by 4
- 2022Deep learning approximations for non-local nonlinear PDEs with Neumann boundary conditionscited by 3
- 2022From Monte Carlo to neural networks approximations of boundary value problemscited by 3
- 2022r-Adaptive Deep Learning Method for Solving Partial Differential Equationscited by 3
- 2023Simultaneous upper and lower bounds of American-style option prices with hedging via neural networkscited by 3
- 2023Capturing the Diffusive Behavior of the Multiscale Linear Transport Equations by Asymptotic-Preserving Convolutional DeepONetscited by 3
- 2023Solving Elliptic Optimal Control Problems via Neural Networks and Optimality Systemcited by 3
- 2024Neural networks in non-metric spacescited by 3
- 2024Multilevel Picard approximations and deep neural networks with ReLU, leaky ReLU, and softplus activation overcome the curse of dimensionality when approximating semilinear parabolic partial differential equations in Lp-sensecited by 3
- 2025FlowKac: An Efficient Neural Fokker-Planck solver using Temporal Normalizing Flows and the Feynman-Kac Formulacited by 3
- 2025Universal Fourier Neural Operators for periodic homogenization problems in linear elasticitycited by 3
- 2023Drift Control of High-Dimensional RBM: A Computational Method Based on Neural Networkscited by 2
- 2023Error Analysis of Option Pricing via Deep PDE Solvers: Empirical Studycited by 2
- 2024Bayesian Differentiable Physics for Cloth Digitalizationcited by 2
- 2024META-ANOVA: Screening interactions for interpretable machine learningcited by 2
- 2024Applications of Scientific Machine Learning for the Analysis of Functionally Graded Porous Beamscited by 2
- 2025Convergence of Stochastic Gradient Methods for Wide Two-Layer Physics-Informed Neural Networks for the Poisson Equationcited by 2
- 2026Shallow ReLUs Networks in Lp-Type and Sobolev Spaces: Approximation and Path-Norm Controlled Generalizationcited by 2
- 2023Algorithmically Designed Artificial Neural Networks (ADANNs): Higher order deep operator learning for parametric partial differential equationscited by 1
- 2023Quantile and moment neural networks for learning functionals of distributionscited by 1
- 2023Probing optimisation in physics-informed neural networkscited by 1
- 2023Efficient Sampling of Stochastic Differential Equations with Positive Semi-Definite Modelscited by 1
- 2023Dynamic Scheduling of a Multiclass Queue in the Halfin-Whitt Regime: A Computational Approach for High-Dimensional Problemscited by 1
- 2024A PNP ion channel deep learning solver with local neural network and finite element input datacited by 1
- 2024Gradient Flow Based Phase-Field Modeling Using Separable Neural Networkscited by 1
- 2025An Iterative Deep Ritz Method for Monotone Elliptic Problemscited by 1
50 most cited of 65 All 65 (JSON)
- 2026Gradient Surgery for Physics-Informed Neural Networks25 Sep 2026
- 2026Residual neural networks overcome the curse of dimensionality for semilinear heat equations3 Sep 2026
- 2026Walk-on-Spheres Monte Carlo and deep neural network approximations of elliptic PDEs with drift and killing10 Aug 2026
- 2026Energy Manifold Natural Gradient Descent: Riemannian Optimization for Neural PDE Solvers24 Jul 2026
- 2026Random Neural Network Expressivity for Non-Linear Partial Differential Equations24 May 2026
- 2026Shallow ReLUs Networks in Lp-Type and Sobolev Spaces: Approximation and Path-Norm Controlled Generalization18 May 2026
- 2025Deep learning methods for inverse problems using connections between proximal operators and Hamilton-Jacobi equations29 Dec 2025
- 2025Convergence of Stochastic Gradient Methods for Wide Two-Layer Physics-Informed Neural Networks for the Poisson Equation29 Aug 2025
- 2025Error analysis for the deep Kolmogorov method23 Aug 2025
- 2025Universal Fourier Neural Operators for periodic homogenization problems in linear elasticity16 Jul 2025
- 2025PADAM: Parallel averaged Adam reduces the error for stochastic optimization in scientific machine learning28 May 2025
- 2025A deep solver for backward stochastic Volterra integral equations23 May 2025
38 more
- 2025A brief review of the Deep BSDE method for solving high-dimensional partial differential equations7 May 2025
- 2025FlowKac: An Efficient Neural Fokker-Planck solver using Temporal Normalizing Flows and the Feynman-Kac Formula14 Mar 2025
- 2025Non-convergence to the optimal risk for Adam and stochastic gradient descent optimization in the training of deep neural networks3 Mar 2025
- 2025Chaos into Order: Neural Framework for Expected Value Estimation of Stochastic Partial Differential Equations5 Feb 2025
- 2025An Iterative Deep Ritz Method for Monotone Elliptic Problems25 Jan 2025
- 2024Multilevel Picard approximations and deep neural networks with ReLU, leaky ReLU, and softplus activation overcome the curse of dimensionality when approximating semilinear parabolic partial differential equations in Lp-sense30 Sep 2024
- 2024Practical Aspects on Solving Differential Equations Using Deep Learning: A Primer21 Aug 2024
- 2024ConFIG: Towards Conflict-free Training of Physics Informed Neural Networks20 Aug 2024
- 2024Applications of Scientific Machine Learning for the Analysis of Functionally Graded Porous Beams4 Aug 2024
- 2024META-ANOVA: Screening interactions for interpretable machine learning2 Aug 2024
- 2024Neural networks in non-metric spaces13 Jun 2024
- 2024Gradient Flow Based Phase-Field Modeling Using Separable Neural Networks9 May 2024
- 2024Full error analysis of the random deep splitting method for nonlinear parabolic PDEs and PIDEs8 May 2024
- 2024Derivative-based regularization for regression1 May 2024
- 2024Macroscopic auxiliary asymptotic preserving neural networks for the linear radiative transfer equations4 Mar 2024
- 2024Bayesian Differentiable Physics for Cloth Digitalization27 Feb 2024
- 2024A PNP ion channel deep learning solver with local neural network and finite element input data31 Jan 2024
- 2023Dynamic Scheduling of a Multiclass Queue in the Halfin-Whitt Regime: A Computational Approach for High-Dimensional Problems29 Nov 2023
- 2023Error Analysis of Option Pricing via Deep PDE Solvers: Empirical Study13 Nov 2023
- 2023Drift Control of High-Dimensional RBM: A Computational Method Based on Neural Networks20 Sep 2023
- 2023Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics3 Sep 2023
- 2023Solving Elliptic Optimal Control Problems via Neural Networks and Optimality System23 Aug 2023
- 2023From continuous-time formulations to discretization schemes: tensor trains and robust regression for BSDEs and parabolic PDEs28 Jul 2023
- 2023On Physical Origins of Learning27 Jul 2023
- 2023Capturing the Diffusive Behavior of the Multiscale Linear Transport Equations by Asymptotic-Preserving Convolutional DeepONets28 Jun 2023
- 2023Global Convergence of Deep Galerkin and PINNs Methods for Solving Partial Differential Equations10 May 2023
- 2023Physics-informed radial basis network (PIRBN): A local approximating neural network for solving nonlinear PDEs13 Apr 2023
- 2023Multilevel CNNs for Parametric PDEs1 Apr 2023
- 2023Efficient Sampling of Stochastic Differential Equations with Positive Semi-Definite Models30 Mar 2023
- 2023Probing optimisation in physics-informed neural networks27 Mar 2023
- 2023Quantile and moment neural networks for learning functionals of distributions20 Mar 2023
- 2023Achieving High Accuracy with PINNs via Energy Natural Gradients25 Feb 2023
- 2023Simultaneous upper and lower bounds of American-style option prices with hedging via neural networks24 Feb 2023
- 2023Algorithmically Designed Artificial Neural Networks (ADANNs): Higher order deep operator learning for parametric partial differential equations7 Feb 2023
- 2022Mean-field neural networks-based algorithms for McKean-Vlasov control problems *22 Dec 2022
- 2022DOSnet as a Non-Black-Box PDE Solver: When Deep Learning Meets Operator Splitting11 Dec 2022
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications15 Nov 2022
- 2022Mean-field neural networks: learning mappings on Wasserstein space27 Oct 2022
50 newest of 65 All 65 (JSON)
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2024ConFIG: Towards Conflict-free Training of Physics Informed Neural Networkscited by 43
- 2021Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neuronscited by 41
- 2021Random feature neural networks learn Black-Scholes type PDEs without curse of dimensionalitycited by 34
- 2023Advances in machine-learning-based sampling motivated by lattice quantum chromodynamicscited by 23
- 2021Interpolating between BSDEs and PINNs: deep learning for elliptic and parabolic boundary value problemscited by 21
- 2022Mean-field neural networks: learning mappings on Wasserstein spacecited by 15
- 2021Error Estimates for the Deep Ritz Method with Boundary Penaltycited by 14
- 2024Full error analysis of the random deep splitting method for nonlinear parabolic PDEs and PIDEscited by 12
- 2022Convergence of a robust deep FBSDE method for stochastic controlcited by 11
- 2022DOSnet as a Non-Black-Box PDE Solver: When Deep Learning Meets Operator Splittingcited by 11
- 2023Achieving High Accuracy with PINNs via Energy Natural Gradientscited by 10
12 most cited of 65 All 65 (JSON)
- 2026Gradient Surgery for Physics-Informed Neural Networks25 Sep 2026
- 2026Residual neural networks overcome the curse of dimensionality for semilinear heat equations3 Sep 2026
- 2026Walk-on-Spheres Monte Carlo and deep neural network approximations of elliptic PDEs with drift and killing10 Aug 2026
- 2026Energy Manifold Natural Gradient Descent: Riemannian Optimization for Neural PDE Solvers24 Jul 2026
- 2026Random Neural Network Expressivity for Non-Linear Partial Differential Equations24 May 2026
- 2026Shallow ReLUs Networks in Lp-Type and Sobolev Spaces: Approximation and Path-Norm Controlled Generalization18 May 2026
- 2025Deep learning methods for inverse problems using connections between proximal operators and Hamilton-Jacobi equations29 Dec 2025
- 2025Convergence of Stochastic Gradient Methods for Wide Two-Layer Physics-Informed Neural Networks for the Poisson Equation29 Aug 2025
- 2025Error analysis for the deep Kolmogorov method23 Aug 2025
- 2025Universal Fourier Neural Operators for periodic homogenization problems in linear elasticity16 Jul 2025
- 2025PADAM: Parallel averaged Adam reduces the error for stochastic optimization in scientific machine learning28 May 2025
- 2025A deep solver for backward stochastic Volterra integral equations23 May 2025
12 newest of 65 All 65 (JSON)