Learning to Optimize Multigrid PDE Solvers
Not on the map. Why?
Abstract (arXiv)
Constructing fast numerical solvers for partial differential equations (PDEs) is crucial for many scientific disciplines. A leading technique for solving large-scale PDEs is using multigrid methods. At the core of a multigrid solver is the prolongation matrix, which relates between different scales of the problem. This matrix is strongly problem-dependent, and its optimal construction is critical to the efficiency of the solver. In practice, however, devising multigrid algorithms for new problems often poses formidable challenges. In this paper we propose a framework for learning multigrid solvers. Our method learns a (single) mapping from a family of parameterized PDEs to prolongation operators. We train a neural network once for the entire class of PDEs, using an efficient and unsupervised loss function. Experiments on a broad class of 2D diffusion problems demonstrate improved convergence rates compared to the widely used Black-Box multigrid scheme, suggesting that our method successfully learned rules for constructing prolongation matrices.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 19; 2023: 12; 2024: 12; 2025: 8; 2026: 15.
79 papers.
Sort:
By area:
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2021Neural Operator: Learning Maps Between Function Spacescited by 413
- 2022Message Passing Neural PDE Solverscited by 368
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 205
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2022Clifford Neural Layers for PDE Modelingcited by 91
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
- 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 53
- 2022Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEscited by 25
38 more
- 2022Multigrid-augmented deep learning preconditioners for the Helmholtz equationcited by 24
- 2021Optimization-Based Algebraic Multigrid Coarsening Using Reinforcement Learningcited by 21
- 2022Guiding continuous operator learning through Physics-based boundary constraintscited by 21
- 2021Spectral Analysis of the Neural Tangent Kernel for Deep Residual Networkscited by 20
- 2022Meta-PDE: Learning to Solve PDEs Quickly Without a Meshcited by 18
- 2021Learning optimal multigrid smoothers via neural networkscited by 17
- 2022A Deep Conjugate Direction Method for Iteratively Solving Linear Systemscited by 12
- 2023MG-GNN: Multigrid Graph Neural Networks for Learning Multilevel Domain Decomposition Methodscited by 12
- 2024Accelerating Data Generation for Neural Operators via Krylov Subspace Recyclingcited by 12
- 2022Learning Interface Conditions in Domain Decomposition Solverscited by 11
- 2023Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation using Compact Implicit Layerscited by 11
- 2021Connections between Numerical Algorithms for PDEs and Neural Networkscited by 10
- 2021Fourier Neural Operator Networks: A Fast and General Solver for the Photoacoustic Wave Equationcited by 10
- 2024Spectral-Refiner: Accurate Fine-Tuning of Spatiotemporal Fourier Neural Operator for Turbulent Flowscited by 10
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solverscited by 9
- 2022A composable machine-learning approach for steady-state simulations on high-resolution gridscited by 8
- 2023Gauge-equivariant neural networks as preconditioners in lattice QCDcited by 8
- 2023Invariant preservation in machine learned PDE solvers via error correctioncited by 7
- 2024Component Fourier Neural Operator for Singularly Perturbed Differential Equationscited by 7
- 2023A Deep Learning algorithm to accelerate Algebraic Multigrid methods in Finite Element solvers of 3D elliptic PDEscited by 6
- 2023Stochastic Unrolled Federated Learningcited by 6
- 2024UGrid: An Efficient-And-Rigorous Neural Multigrid Solver for Linear PDEscited by 6
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Methodcited by 6
- 2022Separable PINN: Mitigating the Curse of Dimensionality in Physics-Informed Neural Networkscited by 5
- 2022Physics-guided Data Augmentation for Learning the Solution Operator of Linear Differential Equationscited by 5
- 2022Optimized Sparse Matrix Operations for Reverse Mode Automatic Differentiationcited by 5
- 2023Gauge-equivariant pooling layers for preconditioners in lattice QCDcited by 5
- 2024Advancing Generalization in PINNs through Latent-Space Representationscited by 5
- 2025Geometric and Physical Constraints Synergistically Enhance Neural PDE Surrogatescited by 5
- 2025SymMaP: Improving Computational Efficiency in Linear Solvers through Symbolic Preconditioningcited by 5
- 2021Translating Numerical Concepts for PDEs into Neural Architecturescited by 4
- 2021Physics-Aware Downsampling with Deep Learning for Scalable Flood Modelingcited by 4
- 2023HyperLoRA for PDEscited by 4
- 2024Up-sampling-only and Adaptive Mesh-based GNN for Simulating Physical Systemscited by 3
- 2026torch-sla: Differentiable Sparse Linear Algebra with Adjoint Solvers and Sparse Tensor Parallelism for PyTorchcited by 3
- 2022Evolving Generalizable Multigrid-Based Helmholtz Preconditioners with Grammar-Guided Genetic Programmingcited by 2
- 2022Learning Relaxation for Multigridcited by 2
- 2023Reducing operator complexity in Algebraic Multigrid with Machine Learning Approachescited by 2
50 most cited of 79 All 79 (JSON)
- 2026RINS: Residual-Image Neural Subspace Solvers for Large Sparse Linear Systems9 Sep 2026
- 2026Learning Spectrally Optimised Mesh-Free Discretisations2 Sep 2026
- 2026Hybrid Lagrangian-Eulerian Model for Lagrangian Fluid Simulation2 Aug 2026
- 2026Generalized Neural Operator for Parametric and Boundary-Value Problems24 Jul 2026
- 2026Acceleration of an algebraic multigrid pressure solver using graph neural networks17 Jun 2026
- 2026RAPNet: Accelerating Algebraic Multigrid with Learned Sparse Corrections26 May 2026
- 2026Multi-Fidelity Flow Matching: Cascaded Refinement of PDE Solutions15 May 2026
- 2026Hybrid Iterative Neural Low-Regularity Integrator for Nonlinear Dispersive Equations6 May 2026
- 2026Automated Grammar-based Algebraic Multigrid Design With Evolutionary Algorithms18 Mar 2026
- 2026Parameterized Temporal Extrapolation of PDEs via Disentangled Latent Dynamics Manifold Fusion13 Mar 2026
- 2026Factorized Neural Implicit DMD for Parametric Dynamics11 Mar 2026
- 2026Deep Accurate Solver for the Geodesic Problem25 Feb 2026
38 more
- 2026Neural-HSS: Hierarchical Semi-Separable Neural PDE Solver20 Feb 2026
- 2026NeuraLSP: A Neural Spectral Preconditioner for Accelerating PDE Solvers28 Jan 2026
- 2026torch-sla: Differentiable Sparse Linear Algebra with Adjoint Solvers and Sparse Tensor Parallelism for PyTorch20 Jan 2026
- 2025ANCHOR: Error-Controlled Adaptive Numerical Correction for Neural Operator Time Marching22 Dec 2025
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solvers4 Nov 2025
- 2025SymMaP: Improving Computational Efficiency in Linear Solvers through Symbolic Preconditioning28 Oct 2025
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Method31 Jul 2025
- 2025Geometric and Physical Constraints Synergistically Enhance Neural PDE Surrogates5 Jun 2025
- 2025MACS: Multi-Agent Reinforcement Learning for Optimization of Crystal Structures4 Jun 2025
- 2025GeoMaNO: Geometric Mamba Neural Operator for Partial Differential Equations17 May 2025
- 2025Online learning to accelerate nonlinear PDE solvers: applied to multiphase porous media flow25 Apr 2025
- 2024Towards Automated Algebraic Multigrid Preconditioner Design Using Genetic Programming for Large-Scale Laser Beam Welding Simulations11 Dec 2024
- 2024Advancing Generalization in PINNs through Latent-Space Representations28 Nov 2024
- 2024Deep Parallel Spectral Neural Operators for Solving Partial Differential Equations with Enhanced Low-Frequency Learning Capability30 Sep 2024
- 2024Component Fourier Neural Operator for Singularly Perturbed Differential Equations7 Sep 2024
- 2024Up-sampling-only and Adaptive Mesh-based GNN for Simulating Physical Systems7 Sep 2024
- 2024UGrid: An Efficient-And-Rigorous Neural Multigrid Solver for Linear PDEs9 Aug 2024
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations9 Jul 2024
- 2024Spectral-Refiner: Accurate Fine-Tuning of Spatiotemporal Fourier Neural Operator for Turbulent Flows27 May 2024
- 2024A Hybrid Kernel-Free Boundary Integral Method with Operator Learning for Solving Parametric Partial Differential Equations In Complex Domains23 Apr 2024
- 2024PDETime: Rethinking Long-Term Multivariate Time Series Forecasting from the perspective of partial differential equations25 Feb 2024
- 2024Neural Multigrid Architectures8 Feb 2024
- 2024Accelerating Data Generation for Neural Operators via Krylov Subspace Recycling17 Jan 2024
- 2023HyperLoRA for PDEs18 Aug 2023
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug 2023
- 2023Investigating Low Data, Confidence Aware Image Prediction on Smooth Repetitive Videos using Gaussian Processes20 Jul 2023
- 2023Reducing operator complexity in Algebraic Multigrid with Machine Learning Approaches15 Jul 2023
- 2023Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation using Compact Implicit Layers30 Jun 2023
- 2023Stochastic Unrolled Federated Learning24 May 2023
- 2023A Deep Learning algorithm to accelerate Algebraic Multigrid methods in Finite Element solvers of 3D elliptic PDEs21 Apr 2023
- 2023Gauge-equivariant pooling layers for preconditioners in lattice QCD20 Apr 2023
- 2023Invariant preservation in machine learned PDE solvers via error correction28 Mar 2023
- 2023Gauge-equivariant neural networks as preconditioners in lattice QCD10 Feb 2023
- 2023Algorithmically Designed Artificial Neural Networks (ADANNs): Higher order deep operator learning for parametric partial differential equations7 Feb 2023
- 2023MG-GNN: Multigrid Graph Neural Networks for Learning Multilevel Domain Decomposition Methods26 Jan 2023
- 2022Guiding continuous operator learning through Physics-based boundary constraints14 Dec 2022
- 2022Optimized Sparse Matrix Operations for Reverse Mode Automatic Differentiation10 Dec 2022
- 2022Physics-guided Data Augmentation for Learning the Solution Operator of Linear Differential Equations8 Dec 2022
50 newest of 79 All 79 (JSON)
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2021Neural Operator: Learning Maps Between Function Spacescited by 413
- 2022Message Passing Neural PDE Solverscited by 368
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2022Clifford Neural Layers for PDE Modelingcited by 91
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
- 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 53
- 2022Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEscited by 25
- 2022Multigrid-augmented deep learning preconditioners for the Helmholtz equationcited by 24
12 most cited of 76 All 76 (JSON)
- 2026RINS: Residual-Image Neural Subspace Solvers for Large Sparse Linear Systems9 Sep 2026
- 2026Learning Spectrally Optimised Mesh-Free Discretisations2 Sep 2026
- 2026Hybrid Lagrangian-Eulerian Model for Lagrangian Fluid Simulation2 Aug 2026
- 2026Generalized Neural Operator for Parametric and Boundary-Value Problems24 Jul 2026
- 2026Acceleration of an algebraic multigrid pressure solver using graph neural networks17 Jun 2026
- 2026RAPNet: Accelerating Algebraic Multigrid with Learned Sparse Corrections26 May 2026
- 2026Hybrid Iterative Neural Low-Regularity Integrator for Nonlinear Dispersive Equations6 May 2026
- 2026Automated Grammar-based Algebraic Multigrid Design With Evolutionary Algorithms18 Mar 2026
- 2026Parameterized Temporal Extrapolation of PDEs via Disentangled Latent Dynamics Manifold Fusion13 Mar 2026
- 2026Factorized Neural Implicit DMD for Parametric Dynamics11 Mar 2026
- 2026Deep Accurate Solver for the Geodesic Problem25 Feb 2026
- 2026Neural-HSS: Hierarchical Semi-Separable Neural PDE Solver20 Feb 2026
12 newest of 76 All 76 (JSON)