mlsanityData to 7 Oct 2026

Convergence of the generalization error for deep gradient flow methods for PDEs

arXiv 2512.25017 ↗First posted 31 Dec 2025math.NA cs.LG cs.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

The aim of this article is to provide a firm mathematical foundation for the application of deep gradient flow methods (DGFMs) for the solution of (high-dimensional) partial differential equations (PDEs). We decompose the generalization error of DGFMs into an approximation and a training error. We first show that the solution of PDEs that satisfy reasonable and verifiable assumptions can be approximated by neural networks, thus the approximation error tends to zero as the number of neurons tends to infinity. Then, we derive the gradient flow that the training process follows in the ``wide network limit'' and analyze the limit of this flow as the training time tends to infinity. These results combined show that the generalization error of DGFMs tends to zero as the number of neurons and the training time tend to infinity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 31 Dec 2025.

Builds on

20 of 39 references.

References · 20

  1. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  2. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
  3. 2019Why gradient clipping accelerates training: A theoretical justification for adaptivitycited by 335
  4. 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
  5. 2019Variational Physics-Informed Neural Networks For Solving Partial Differential Equationscited by 144
  6. 2020Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEscited by 115
  7. 2023Can Physics-Informed Neural Networks beat the Finite Element Method?cited by 68
  8. 2022Neural Galerkin Schemes with Active Learning for High-Dimensional Evolution Equationscited by 55
  9. 2020Analysis of Stochastic Gradient Descent in Continuous Timecited by 24
  10. 2021The Deep Minimizing Movement Schemecited by 15
  11. 2016Stochastic Gradient Descent in Continuous Timecited by 14
  12. 2017Stochastic Gradient Descent in Continuous Time: A Central Limit Theoremcited by 10
8 more
  1. 2023Global Convergence of Deep Galerkin and PINNs Methods for Solving Partial Differential Equationscited by 10
  2. 2021A Continuous-time Stochastic Gradient Descent Method for Continuous Datacited by 7
  3. 2024A deep implicit-explicit minimizing movement method for option pricing in jump-diffusion modelscited by 5
  4. 2024A time-stepping deep gradient flow method for option pricing in (rough) diffusion modelscited by 3
  5. 2022Losing momentum in continuous-time stochastic optimisationcited by 2
  6. 2023A new approach to generalisation error of machine learning algorithms: Estimates and convergencecited by 2
  7. 2024Leveraging the turnpike effect for Mean Field Games numericscited by 1
  8. 2024How to beat a Bayesian adversarycited by 1

Built on by

Not cited yet.