mlsanityData to 7 Oct 2026

Unbiased and Second-Order-Free Training for High-Dimensional PDEs

arXiv 2605.14643 ↗First posted 14 May 2026cs.LG cs.NA math.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning methods based on backward stochastic differential equations (BSDEs) have emerged as competitive alternatives to physics-informed neural networks (PINNs) for solving high-dimensional partial differential equations (PDEs). By leveraging probabilistic representations, BSDE approaches can avoid the curse of dimensionality and often admit second-order-free training objectives that do not require explicit Hessian evaluations. It has recently been established that the commonly used Euler-Maruyama (EM) time discretization induces an intrinsic bias in BSDE training losses. While high-order schemes such as Heun can fully eliminate this bias, such schemes re-introduce second-order spatial derivatives and incur substantial computational overhead. In this work, we provide a principled analysis of EM-induced loss bias and propose an unbiased, second-order-free training framework that preserves the computational advantages of BSDE methods. Our code is available at https://github.com/seojaemin22/Un-EM-BSDE.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

21 of 34 references.

References · 21

  1. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  2. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  3. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  4. 2017Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equationscited by 188
  5. 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 109
  6. 2023Tackling the Curse of Dimensionality with Physics-Informed Neural Networkscited by 78
  7. 2017Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equationscited by 62
  8. 2018Forward-Backward Stochastic Neural Networks: Deep Learning of High-dimensional Partial Differential Equationscited by 54
  9. 2019Deep splitting method for parabolic PDEscited by 53
  10. 2018Hidden Fluid Mechanics: A Navier-Stokes Informed Deep Learning Framework for Assimilating Flow Visualization Datacited by 36
  11. 2020Randomized Automatic Differentiationcited by 23
  12. 2023Hutchinson Trace Estimation for High-Dimensional and High-Order Physics-Informed Neural Networkscited by 23
9 more
  1. 2021Interpolating between BSDEs and PINNs: deep learning for elliptic and parabolic boundary value problemscited by 21
  2. 2020Approximation error analysis of some deep backward schemes for nonlinear PDEscited by 20
  3. 2024Stochastic Taylor Derivative Estimator: Efficient amortization for arbitrary differential operatorscited by 20
  4. 2023Bias-Variance Trade-off in Physics-Informed Neural Networks with Randomized Smoothing for High-Dimensional PDEscited by 19
  5. 2024Full error analysis of the random deep splitting method for nonlinear parabolic PDEs and PIDEscited by 12
  6. 2022A Unified Hard-Constraint Framework for Solving Geometrically Complex PDEscited by 11
  7. 2025A brief review of the Deep BSDE method for solving high-dimensional partial differential equationscited by 5
  8. 2025Integration Matters for Learning PDEs with Backward SDEscited by 3
  9. 2025Collapsing Taylor Mode Automatic Differentiationcited by 1

Built on by

Not cited yet.