mlsanityData to 14 Oct 2026

Error analysis for the deep Kolmogorov method

arXiv 2508.17167 ↗First posted 23 Aug 2025math.NA cs.AI cs.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

The deep Kolmogorov method is a simple and popular deep learning based method for approximating solutions of partial differential equations (PDEs) of the Kolmogorov type. In this work we provide an error analysis for the deep Kolmogorov method for heat PDEs. Specifically, we reveal convergence with convergence rates for the overall mean square distance between the exact solution of the heat PDE and the realization function of the approximating deep neural network (DNN) associated with a stochastic optimization algorithm in terms of the size of the architecture (the depth/number of hidden layers and the width of the hidden layers) of the approximating DNN, in terms of the number of random sample points used in the loss function (the number of input-output data pairs used in the loss function), and in terms of the size of the optimization error made by the employed stochastic optimization method.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 61 of its 104 references that are in the map. First posted on arXiv 23 Aug 2025.

Builds on

61 of 104 references.

References · 61

  1. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 678
  2. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
  3. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 583
  4. 2016Error bounds for approximations with deep ReLU networkscited by 574
  5. 2017Solving high-dimensional partial differential equations using deep learningcited by 556
  6. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 473
  7. 2017Nonparametric regression using deep neural networks with ReLU activation functioncited by 433
  8. 2017Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equationscited by 191
  9. 2017Optimal approximation of piecewise smooth functions using deep ReLU neural networkscited by 179
  10. 2020Deep Network Approximation for Smooth Functionscited by 164
  11. 2020Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEscited by 116
  12. 2019Error bounds for approximations with deep ReLU neural networks in Ws,p normscited by 95
38 more
  1. 2023Tackling the Curse of Dimensionality with Physics-Informed Neural Networkscited by 79
  2. 2020Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learningcited by 77
  3. 2019A Theoretical Analysis of Deep Neural Networks and Parametric PDEscited by 74
  4. 2020An overview on deep learning-based approximation methods for partial differential equationscited by 65
  5. 2018A proof that artificial neural networks overcome the curse of dimensionality in the numerical approximation of Black-Scholes partial differential equationscited by 55
  6. 2019Deep splitting method for parabolic PDEscited by 53
  7. 2019Approximation spaces of deep neural networkscited by 51
  8. 2018Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black-Scholes Partial Differential Equationscited by 45
  9. 2018Convergence of the Deep BSDE Method for Coupled FBSDEscited by 43
  10. 2018Solving the Kolmogorov PDE by means of deep learningcited by 41
  11. 2020Two-Layer Neural Networks for Partial Differential Equations: Optimization and Generalization Theorycited by 41
  12. 2024Numerical analysis of physics-informed neural networks and related models in physics-informed machine learningcited by 39
  13. 2019Convergence Analysis of Machine Learning Algorithms for the Numerical Solution of Mean Field Control and Games: II -- The Finite Horizon Casecited by 34
  14. 2021Random feature neural networks learn Black-Scholes type PDEs without curse of dimensionalitycited by 34
  15. 2020Expressivity of Deep Neural Networkscited by 32
  16. 2018Machine Learning for semi linear PDEscited by 28
  17. 2021Neural networks-based algorithms for stochastic control and PDEs in financecited by 26
  18. 2023Recent Developments in Machine Learning Methods for Stochastic Control and Gamescited by 24
  19. 2020Numerically Solving Parametric Families of High-Dimensional Kolmogorov Partial Differential Equations via Deep Learningcited by 22
  20. 2020Approximation error analysis of some deep backward schemes for nonlinear PDEscited by 21
  21. 2023Mathematical Introduction to Deep Learning: Methods, Implementations, and Theorycited by 20
  22. 2020Friedrichs Learning: Weak Solutions of Partial Differential Equations via Deep Learningcited by 18
  23. 2019Full error analysis for the training of deep neural networkscited by 17
  24. 2024Non-convergence of Adam and other adaptive stochastic gradient descent optimization methods for non-vanishing learning ratescited by 15
  25. 2020Approximations with deep neural networks in Sobolev time-spacecited by 13
  26. 2023Universal approximation property of Banach space-valued random feature models including random neural networkscited by 13
  27. 2024Physics-informed machine learning as a kernel methodcited by 13
  28. 2019Rectified deep neural networks overcome the curse of dimensionality for nonsmooth value functions in zero-sum games of nonlinear stiff systemscited by 12
  29. 2022Convergence of a robust deep FBSDE method for stochastic controlcited by 12
  30. 2023Rates of Approximation by ReLU Shallow Neural Networkscited by 12
  31. 2024Full error analysis of the random deep splitting method for nonlinear parabolic PDEs and PIDEscited by 12
  32. 2019Uniform error estimates for artificial neural network approximations for heat equationscited by 11
  33. 2024Physics-informed kernel learningcited by 11
  34. 2020Convergence of Deep Fictitious Play for Stochastic Differential Gamescited by 10
  35. 2021Convergence proof for stochastic gradient descent in the training of deep neural networks with ReLU activation for constant target functionscited by 9
  36. 2022Deep neural network expressivity for optimal stopping problemscited by 9
  37. 2024Non-convergence to global minimizers in data driven supervised deep learning: Adam and stochastic gradient descent optimization provably fail to converge to global minimizers in the training of deep neural networks with ReLU activationcited by 8
  38. 2021Convergence of the Deep BSDE method for FBSDEs with non-Lipschitz coefficientscited by 7

50 most cited of 61 All 61 (JSON)

Built on by

Not cited yet.