Learning Neural PDE Solvers with Convergence Guarantees
Not on the map. Why?
Abstract (arXiv)
Partial differential equations (PDEs) are widely used across the physical and computational sciences. Decades of research and engineering went into designing fast iterative solution methods. Existing solvers are general purpose, but may be sub-optimal for specific classes of problems. In contrast to existing hand-crafted solutions, we propose an approach to learn a fast iterative solver tailored to a specific domain. We achieve this goal by learning to modify the updates of an existing solver using a deep neural network. Crucially, our approach is proven to preserve strong correctness and convergence guarantees. After training on a single geometry, our model generalizes to a wide variety of geometries and boundary conditions, and achieves 2-3 times speedup compared to state-of-the-art solvers.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 15; 2023: 16; 2024: 15; 2025: 10; 2026: 9.
77 papers.
Sort:
By area:
- 2022Message Passing Neural PDE Solverscited by 368
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 205
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2022Clifford Neural Layers for PDE Modelingcited by 91
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
- 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 53
- 2021Reinforcement Learning for Adaptive Mesh Refinementcited by 37
- 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 37
- 2024UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptationcited by 27
- 2021Optimization-Based Algebraic Multigrid Coarsening Using Reinforcement Learningcited by 21
38 more
- 2023Deep Learning in Deterministic Computational Mechanicscited by 21
- 2025DISCO: learning to DISCover an evolution Operator for multi-physics-agnostic predictioncited by 21
- 2023Deep Equilibrium Based Neural Operators for Steady-State PDEscited by 19
- 2022Meta-PDE: Learning to Solve PDEs Quickly Without a Meshcited by 18
- 2021Learning optimal multigrid smoothers via neural networkscited by 17
- 2022Learning the Solution Operator of Boundary Value Problems using Graph Neural Networkscited by 17
- 2023Latent Traversals in Generative Models as Potential Flowscited by 17
- 2022Neural Network Approximations of PDEs Beyond Linearity: A Representational Perspectivecited by 15
- 2024Accelerating PDE Data Generation via Differential Operator Action in Solution Spacecited by 15
- 2022A Deep Conjugate Direction Method for Iteratively Solving Linear Systemscited by 12
- 2024Accelerating Data Generation for Neural Operators via Krylov Subspace Recyclingcited by 12
- 2021Convergent Graph Solverscited by 11
- 2021Physics-Augmented Learning: A New Paradigm Beyond Physics-Informed Learningcited by 11
- 2023NeuralStagger: Accelerating Physics-constrained Neural PDE Solver with Spatial-temporal Decompositioncited by 11
- 2023Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation using Compact Implicit Layerscited by 11
- 2023Flow Factorized Representation Learningcited by 11
- 2022LordNet: An Efficient Neural Network for Learning to Solve Parametric Partial Differential Equations without Simulated Datacited by 10
- 2024Learning a Neural Solver for Parametric PDE to Enhance Physics-Informed Methodscited by 10
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solverscited by 9
- 2021Performance and accuracy assessments of an incompressible fluid solver coupled with a deep Convolutional Neural Networkcited by 8
- 2023Invariant preservation in machine learned PDE solvers via error correctioncited by 7
- 2021An Interpretive Constrained Linear Model for ResNet and MgNetcited by 6
- 2022Side Effects of Learning from Low-dimensional Data Embedded in a Euclidean Spacecited by 6
- 2022Principled Acceleration of Iterative Numerical Methods Using Machine Learningcited by 6
- 2024M2NO: An Efficient Multi-Resolution Operator Framework for Dynamic Multi-Scale PDE Solverscited by 6
- 2024UGrid: An Efficient-And-Rigorous Neural Multigrid Solver for Linear PDEscited by 6
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Methodcited by 6
- 2021Neural network architectures using min-plus algebra for solving certain high dimensional optimal control problems and Hamilton-Jacobi PDEscited by 5
- 2022Physics-guided Data Augmentation for Learning the Solution Operator of Linear Differential Equationscited by 5
- 2023RANS-PINN based Simulation Surrogates for Predicting Turbulent Flowscited by 5
- 2024Latent Neural PDE Solver: a reduced-order modelling framework for partial differential equationscited by 5
- 2025Geometric and Physical Constraints Synergistically Enhance Neural PDE Surrogatescited by 5
- 2025Accurate and scalable deep Maxwell solvers using multilevel iterative methodscited by 5
- 2025SymMaP: Improving Computational Efficiency in Linear Solvers through Symbolic Preconditioningcited by 5
- 2026OpInf-LLM: Parametric PDE Solving with LLMs via Operator Inferencecited by 4
- 2022Leveraging Stochastic Predictions of Bayesian Neural Networks for Fluid Simulationscited by 3
- 2023An Implicit GNN Solver for Poisson-like problemscited by 3
- 2024Stabilizing Backpropagation Through Time to Learn Complex Physicscited by 3
50 most cited of 77 All 77 (JSON)
- 2026Transferability of Learned States in Neural PDE Solvers7 Oct 2026
- 2026Beyond Simulation: Retain-and-Repair Neural Operators for Real-World Adaptation30 Sep 2026
- 2026Repairability of Inexact Solvers in Recursive State Estimation with Machine Learning23 Sep 2026
- 2026Physics-enriched neural solvers for transient ice-flow simulation11 Sep 2026
- 2026Learning Spectrally Optimised Mesh-Free Discretisations2 Sep 2026
- 2026NPSolver: Neural Poisson Solver with Iterative Physics Supervision25 May 2026
- 2026Factorized Neural Implicit DMD for Parametric Dynamics11 Mar 2026
- 2026Deep Accurate Solver for the Geodesic Problem25 Feb 2026
- 2026OpInf-LLM: Parametric PDE Solving with LLMs via Operator Inference2 Feb 2026
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solvers4 Nov 2025
- 2025SymMaP: Improving Computational Efficiency in Linear Solvers through Symbolic Preconditioning28 Oct 2025
- 2025Accelerating Data Generation for Nonlinear temporal PDEs via homologous perturbation in solution space24 Oct 2025
38 more
- 2025Accurate and scalable deep Maxwell solvers using multilevel iterative methods3 Sep 2025
- 2025Data-Augmented Few-Shot Neural Emulator for Computer-Model System Identification26 Aug 2025
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Method31 Jul 2025
- 2025Accelerating PDE-Constrained Optimization by the Derivative of Neural Operators16 Jun 2025
- 2025Geometric and Physical Constraints Synergistically Enhance Neural PDE Surrogates5 Jun 2025
- 2025DISCO: learning to DISCover an evolution Operator for multi-physics-agnostic prediction28 Apr 2025
- 2025Online learning to accelerate nonlinear PDE solvers: applied to multiphase porous media flow25 Apr 2025
- 2024Using Parametric PINNs for Predicting Internal and External Turbulent Flows24 Oct 2024
- 2024Learning a Neural Solver for Parametric PDE to Enhance Physics-Informed Methods9 Oct 2024
- 2024Unsupervised Representation Learning from Sparse Transformation Analysis7 Oct 2024
- 2024UGrid: An Efficient-And-Rigorous Neural Multigrid Solver for Linear PDEs9 Aug 2024
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations9 Jul 2024
- 2024M2NO: An Efficient Multi-Resolution Operator Framework for Dynamic Multi-Scale PDE Solvers7 Jun 2024
- 2024ConDiff: A Challenging Dataset for Neural Solvers of Partial Differential Equations7 Jun 2024
- 2024Accelerating Legacy Numerical Solvers by Non-intrusive Gradient-based Meta-solving5 May 2024
- 2024Stabilizing Backpropagation Through Time to Learn Complex Physics3 May 2024
- 2024UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptation11 Mar 2024
- 2024Latent Neural PDE Solver: a reduced-order modelling framework for partial differential equations27 Feb 2024
- 2024PDETime: Rethinking Long-Term Multivariate Time Series Forecasting from the perspective of partial differential equations25 Feb 2024
- 2024Neural Multigrid Architectures8 Feb 2024
- 2024Accelerating PDE Data Generation via Differential Operator Action in Solution Space4 Feb 2024
- 2024Accelerating Data Generation for Neural Operators via Krylov Subspace Recycling17 Jan 2024
- 2023Deep Equilibrium Based Neural Operators for Steady-State PDEs30 Nov 2023
- 2023Interpretable Neural PDE Solvers using Symbolic Frameworks31 Oct 2023
- 2023A Spectral Approach for Learning Spatiotemporal Neural Differential Equations28 Sep 2023
- 2023Deep Learning in Deterministic Computational Mechanics27 Sep 2023
- 2023Flow Factorized Representation Learning22 Sep 2023
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug 2023
- 2023Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation using Compact Implicit Layers30 Jun 2023
- 2023Towards a Machine-Learned Poisson Solver for Low-Temperature Plasma Simulations in Complex Geometries13 Jun 2023
- 2023RANS-PINN based Simulation Surrogates for Predicting Turbulent Flows9 Jun 2023
- 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attention27 Apr 2023
- 2023Latent Traversals in Generative Models as Potential Flows25 Apr 2023
- 2023Invariant preservation in machine learned PDE solvers via error correction28 Mar 2023
- 2023Neural Partial Differential Equations with Functional Convolution10 Mar 2023
- 2023NeuralStagger: Accelerating Physics-constrained Neural PDE Solver with Spatial-temporal Decomposition20 Feb 2023
- 2023Algorithmically Designed Artificial Neural Networks (ADANNs): Higher order deep operator learning for parametric partial differential equations7 Feb 2023
- 2023An Implicit GNN Solver for Poisson-like problems6 Feb 2023
50 newest of 77 All 77 (JSON)
- 2022Message Passing Neural PDE Solverscited by 368
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2022Clifford Neural Layers for PDE Modelingcited by 91
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
- 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 53
- 2021Reinforcement Learning for Adaptive Mesh Refinementcited by 37
- 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 37
- 2024UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptationcited by 27
- 2021Optimization-Based Algebraic Multigrid Coarsening Using Reinforcement Learningcited by 21
- 2023Deep Learning in Deterministic Computational Mechanicscited by 21
12 most cited of 76 All 76 (JSON)
- 2026Transferability of Learned States in Neural PDE Solvers7 Oct 2026
- 2026Beyond Simulation: Retain-and-Repair Neural Operators for Real-World Adaptation30 Sep 2026
- 2026Repairability of Inexact Solvers in Recursive State Estimation with Machine Learning23 Sep 2026
- 2026Physics-enriched neural solvers for transient ice-flow simulation11 Sep 2026
- 2026Learning Spectrally Optimised Mesh-Free Discretisations2 Sep 2026
- 2026NPSolver: Neural Poisson Solver with Iterative Physics Supervision25 May 2026
- 2026Factorized Neural Implicit DMD for Parametric Dynamics11 Mar 2026
- 2026Deep Accurate Solver for the Geodesic Problem25 Feb 2026
- 2026OpInf-LLM: Parametric PDE Solving with LLMs via Operator Inference2 Feb 2026
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solvers4 Nov 2025
- 2025SymMaP: Improving Computational Efficiency in Linear Solvers through Symbolic Preconditioning28 Oct 2025
- 2025Accelerating Data Generation for Nonlinear temporal PDEs via homologous perturbation in solution space24 Oct 2025
12 newest of 76 All 76 (JSON)