Unbiased and Second-Order-Free Training for High-Dimensional PDEs
Not on the map. Why?
Abstract (arXiv)
Deep learning methods based on backward stochastic differential equations (BSDEs) have emerged as competitive alternatives to physics-informed neural networks (PINNs) for solving high-dimensional partial differential equations (PDEs). By leveraging probabilistic representations, BSDE approaches can avoid the curse of dimensionality and often admit second-order-free training objectives that do not require explicit Hessian evaluations. It has recently been established that the commonly used Euler-Maruyama (EM) time discretization induces an intrinsic bias in BSDE training losses. While high-order schemes such as Heun can fully eliminate this bias, such schemes re-introduce second-order spatial derivatives and incur substantial computational overhead. In this work, we provide a principled analysis of EM-induced loss bias and propose an unbiased, second-order-free training framework that preserves the computational advantages of BSDE methods. Our code is available at https://github.com/seojaemin22/Un-EM-BSDE.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
21 of 34 references.
References · 21
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2017Solving high-dimensional partial differential equations using deep learningcited by 549
- 2017Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equationscited by 188
- 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 109
- 2023Tackling the Curse of Dimensionality with Physics-Informed Neural Networkscited by 78
- 2017Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equationscited by 62
- 2018Forward-Backward Stochastic Neural Networks: Deep Learning of High-dimensional Partial Differential Equationscited by 54
- 2019Deep splitting method for parabolic PDEscited by 53
- 2018Hidden Fluid Mechanics: A Navier-Stokes Informed Deep Learning Framework for Assimilating Flow Visualization Datacited by 36
- 2020Randomized Automatic Differentiationcited by 23
- 2023Hutchinson Trace Estimation for High-Dimensional and High-Order Physics-Informed Neural Networkscited by 23
9 more
- 2021Interpolating between BSDEs and PINNs: deep learning for elliptic and parabolic boundary value problemscited by 21
- 2020Approximation error analysis of some deep backward schemes for nonlinear PDEscited by 20
- 2024Stochastic Taylor Derivative Estimator: Efficient amortization for arbitrary differential operatorscited by 20
- 2023Bias-Variance Trade-off in Physics-Informed Neural Networks with Randomized Smoothing for High-Dimensional PDEscited by 19
- 2024Full error analysis of the random deep splitting method for nonlinear parabolic PDEs and PIDEscited by 12
- 2022A Unified Hard-Constraint Framework for Solving Geometrically Complex PDEscited by 11
- 2025A brief review of the Deep BSDE method for solving high-dimensional partial differential equationscited by 5
- 2025Integration Matters for Learning PDEs with Backward SDEscited by 3
- 2025Collapsing Taylor Mode Automatic Differentiationcited by 1
Built on by
Not cited yet.