Solving Poisson Equations using Neural Walk-on-Spheres
Not on the map. Why?
Abstract (arXiv)
We propose Neural Walk-on-Spheres (NWoS), a novel neural PDE solver for the efficient solution of high-dimensional Poisson equations. Leveraging stochastic representations and Walk-on-Spheres methods, we develop novel losses for neural networks based on the recursive solution of Poisson equations on spheres inside the domain. The resulting method is highly parallelizable and does not require spatial gradients for the loss. We provide a comprehensive comparison against competing methods based on PINNs, the Deep Ritz method, and (backward) stochastic differential equations. In several challenging, high-dimensional numerical examples, we demonstrate the superiority of NWoS in accuracy, speed, and computational costs. Compared to commonly used PINNs, our approach can reduce memory usage and errors by orders of magnitude. Furthermore, we apply NWoS to problems in PDE-constrained optimization and molecular dynamics to show its efficiency in practical applications.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 25 of its 60 references that are in the map. First posted on arXiv 5 Jun 2024.
Builds on
25 of 60 references.
References · 25
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
- 2017Solving high-dimensional partial differential equations using deep learningcited by 549
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
- 2017Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equationscited by 188
- 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 118
- 2020Solving high-dimensional Hamilton-Jacobi-Bellman PDEs using neural networks: perspectives from the theory of controlled diffusions and measures on path spacecited by 80
- 2021DAS-PINNs: A deep adaptive sampling method for solving high-dimensional partial differential equationscited by 66
13 more
- 2017Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equationscited by 62
- 2021Error analysis for physics informed neural networks (PINNs) approximating Kolmogorov PDEscited by 56
- 2023A unified scalable framework for causal sweeping strategies for Physics-Informed Neural Networks (PINNs) and their temporal decompositionscited by 48
- 2018Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black-Scholes Partial Differential Equationscited by 44
- 2021Solving PDE-constrained Control Problems Using Operator Learningcited by 41
- 2020Numerically Solving Parametric Families of High-Dimensional Kolmogorov Partial Differential Equations via Deep Learningcited by 22
- 2021Interpolating between BSDEs and PINNs: deep learning for elliptic and parabolic boundary value problemscited by 21
- 2020A Derivative-Free Method for Solving Elliptic Partial Differential Equations with Deep Neural Networkscited by 13
- 2022Robust SDE-Based Variational Formulations for Solving Linear PDEs via Deep Learningcited by 13
- 2022Grid-Free Monte Carlo for PDEs with Spatially Varying Coefficientscited by 12
- 2023Walk on Stars: A Grid-Free Monte Carlo Method for PDEs with Neumann Boundary Conditionscited by 8
- 2023Boundary Value Caching for Walk on Spherescited by 6
- 2022From Monte Carlo to neural networks approximations of boundary value problemscited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 5.
11 papers.
- 2024DiffusionPDE: Generative PDE-Solving Under Partial Observationcited by 100
- 2025Neural Green's Functionscited by 6
- 2024Learning Lagrangian Interaction Dynamics with Sampling-Based Model Order Reductioncited by 2
- 2025DeepRWCap: Neural-Guided Random-Walk Capacitance Solver for IC Designcited by 2
- 2026Mollified Value Learningcited by 1
- 2026Operator Learning Using Weak Supervision from Walk-on-Spherescited by 1
- 2025Walk-on-Interfaces: A Monte Carlo Estimator for an Elliptic Interface Problem with Nonhomogeneous Flux Jump Conditions and a Neumann Boundary Conditioncited by 0
- 2025WoSNN: Stochastic Solver for PDEs with Machine Learningcited by 0
- 2026Feature Learning for the High Dimensional Stationary Sch"odinger Equation with Deep Ritz Methodcited by 0
- 2026Layerwise Decoupling for Stable Structured Sparsification of Fully Connected Layerscited by 0
- 2026Neural Harmonic Measure Operatorcited by 0
- 2026Neural Harmonic Measure Operator28 Sep 2026
- 2026Layerwise Decoupling for Stable Structured Sparsification of Fully Connected Layers17 Sep 2026
- 2026Feature Learning for the High Dimensional Stationary Sch"odinger Equation with Deep Ritz Method7 Jul 2026
- 2026Operator Learning Using Weak Supervision from Walk-on-Spheres1 Mar 2026
- 2026Mollified Value Learning26 Feb 2026
- 2025DeepRWCap: Neural-Guided Random-Walk Capacitance Solver for IC Design10 Nov 2025
- 2025Neural Green's Functions2 Nov 2025
- 2025WoSNN: Stochastic Solver for PDEs with Machine Learning29 Aug 2025
- 2025Walk-on-Interfaces: A Monte Carlo Estimator for an Elliptic Interface Problem with Nonhomogeneous Flux Jump Conditions and a Neumann Boundary Condition22 Aug 2025
- 2024Learning Lagrangian Interaction Dynamics with Sampling-Based Model Order Reduction4 Jul 2024
- 2024DiffusionPDE: Generative PDE-Solving Under Partial Observation25 Jun 2024