Learning Algebraic Multigrid Using Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Efficient numerical solvers for sparse linear systems are crucial in science and engineering. One of the fastest methods for solving large-scale sparse linear systems is algebraic multigrid (AMG). The main challenge in the construction of AMG algorithms is the selection of the prolongation operator -- a problem-dependent sparse matrix which governs the multiscale hierarchy of the solver and is critical to its efficiency. Over many years, numerous methods have been developed for this task, and yet there is no known single right answer except in very special cases. Here we propose a framework for learning AMG prolongation operators for linear systems with sparse symmetric positive (semi-) definite matrices. We train a single graph neural network to learn a mapping from an entire class of such matrices to prolongation operators, using an efficient unsupervised loss function. Experiments on a broad class of problems demonstrate improved convergence rates compared to classical AMG, demonstrating the potential utility of neural networks for developing sparse system solvers.
Key facts. Cited by 54 papers in the map (data through 13 Oct 2026). First posted on arXiv 12 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 11; 2023: 9; 2024: 8; 2025: 8; 2026: 12.
54 papers.
Sort:
By area:
- 2022MultiScale MeshGraphNetscited by 95
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 54
- 2021Reinforcement Learning for Adaptive Mesh Refinementcited by 39
- 2022Generalization Bounds for Data-Driven Numerical Linear Algebracited by 24
- 2021Optimization-Based Algebraic Multigrid Coarsening Using Reinforcement Learningcited by 21
- 2021Learning optimal multigrid smoothers via neural networkscited by 17
- 2021Solving PDEs on Unknown Manifolds with Machine Learningcited by 12
- 2022A Deep Conjugate Direction Method for Iteratively Solving Linear Systemscited by 12
- 2023MG-GNN: Multigrid Graph Neural Networks for Learning Multilevel Domain Decomposition Methodscited by 12
- 2022Learning Interface Conditions in Domain Decomposition Solverscited by 11
- 2024Algorithm Configuration for Structured Pfaffian Settingscited by 11
38 more
- 2022SoK: Differential Privacy on Graph-Structured Datacited by 10
- 2025Graph neural networks extrapolate out-of-distribution for shortest pathscited by 10
- 2024Multi-Grid Graph Neural Networks with Self-Attention for Computational Mechanicscited by 9
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solverscited by 9
- 2023Gauge-equivariant neural networks as preconditioners in lattice QCDcited by 8
- 2023Invariant preservation in machine learned PDE solvers via error correctioncited by 7
- 2022Principled Acceleration of Iterative Numerical Methods Using Machine Learningcited by 6
- 2023A Deep Learning algorithm to accelerate Algebraic Multigrid methods in Finite Element solvers of 3D elliptic PDEscited by 6
- 2023Graph Neural Networks and Applied Linear Algebracited by 6
- 2024UGrid: An Efficient-And-Rigorous Neural Multigrid Solver for Linear PDEscited by 6
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Methodcited by 6
- 2021Distributed Multigrid Neural Solvers on Megavoxel Domainscited by 5
- 2022Optimized Sparse Matrix Operations for Reverse Mode Automatic Differentiationcited by 5
- 2023Gauge-equivariant pooling layers for preconditioners in lattice QCDcited by 5
- 2025Accurate and scalable deep Maxwell solvers using multilevel iterative methodscited by 5
- 2025SymMaP: Improving Computational Efficiency in Linear Solvers through Symbolic Preconditioningcited by 5
- 2022AI-enhanced iterative solvers for accelerating the solution of large scale parametrized systemscited by 3
- 2025PEARL: Preconditioner Enhancement through Actor-critic Reinforcement Learningcited by 3
- 2026torch-sla: Differentiable Sparse Linear Algebra with Adjoint Solvers and Sparse Tensor Parallelism for PyTorchcited by 3
- 2022Evolving Generalizable Multigrid-Based Helmholtz Preconditioners with Grammar-Guided Genetic Programmingcited by 2
- 2022Learning Relaxation for Multigridcited by 2
- 2023Reducing operator complexity in Algebraic Multigrid with Machine Learning Approachescited by 2
- 2024Accelerating Legacy Numerical Solvers by Non-intrusive Gradient-based Meta-solvingcited by 2
- 2025Message-Passing GNNs Fail to Approximate Sparse Triangular Factorizationscited by 2
- 2021Construction of Grid Operators for Multilevel Solvers: a Neural Network Approachcited by 1
- 2024Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systemscited by 1
- 2024Towards Automated Algebraic Multigrid Preconditioner Design Using Genetic Programming for Large-Scale Laser Beam Welding Simulationscited by 1
- 2026Neural-HSS: Hierarchical Semi-Separable Neural PDE Solvercited by 1
- 2023Learning to Relax: Setting Solver Parameters Across a Sequence of Linear System Instancescited by 0
- 2023Improving Pseudo-Time Stepping Convergence for CFD Simulations With Neural Networkscited by 0
- 2024Neural Multigrid Architecturescited by 0
- 2025Graph Lineages and Skeletal Graph Productscited by 0
- 2026NeuraLSP: A Neural Spectral Preconditioner for Accelerating PDE Solverscited by 0
- 2026Correction of Transformer-Based Models with Smoothing Pseudo-Projectorcited by 0
- 2026Automated Grammar-based Algebraic Multigrid Design With Evolutionary Algorithmscited by 0
- 2026Autonomous Adaptive Solver Selection for Chemistry Integration via Reinforcement Learningcited by 0
- 2026Hybrid Iterative Neural Low-Regularity Integrator for Nonlinear Dispersive Equationscited by 0
- 2026Bridging the Gap between Sparse Matrix Reordering and Factorization: A Deep Learning Framework for Fill-in Reductioncited by 0
50 most cited of 54 All 54 (JSON)
- 2026Graph Neural Multilevel Preconditioners for Iterative Solvers30 Jul 2026
- 2026Acceleration of an algebraic multigrid pressure solver using graph neural networks17 Jun 2026
- 2026RAPNet: Accelerating Algebraic Multigrid with Learned Sparse Corrections26 May 2026
- 2026Learning Fill-in Reduction Ordering via Graph Policy Optimization for Sparse Matrices17 May 2026
- 2026Bridging the Gap between Sparse Matrix Reordering and Factorization: A Deep Learning Framework for Fill-in Reduction17 May 2026
- 2026Hybrid Iterative Neural Low-Regularity Integrator for Nonlinear Dispersive Equations6 May 2026
- 2026Autonomous Adaptive Solver Selection for Chemistry Integration via Reinforcement Learning31 Mar 2026
- 2026Automated Grammar-based Algebraic Multigrid Design With Evolutionary Algorithms18 Mar 2026
- 2026Correction of Transformer-Based Models with Smoothing Pseudo-Projector10 Mar 2026
- 2026Neural-HSS: Hierarchical Semi-Separable Neural PDE Solver20 Feb 2026
- 2026NeuraLSP: A Neural Spectral Preconditioner for Accelerating PDE Solvers28 Jan 2026
- 2026torch-sla: Differentiable Sparse Linear Algebra with Adjoint Solvers and Sparse Tensor Parallelism for PyTorch20 Jan 2026
38 more
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solvers4 Nov 2025
- 2025SymMaP: Improving Computational Efficiency in Linear Solvers through Symbolic Preconditioning28 Oct 2025
- 2025Accurate and scalable deep Maxwell solvers using multilevel iterative methods3 Sep 2025
- 2025Graph Lineages and Skeletal Graph Products31 Jul 2025
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Method31 Jul 2025
- 2025Graph neural networks extrapolate out-of-distribution for shortest paths24 Mar 2025
- 2025Message-Passing GNNs Fail to Approximate Sparse Triangular Factorizations3 Feb 2025
- 2025PEARL: Preconditioner Enhancement through Actor-critic Reinforcement Learning18 Jan 2025
- 2024Towards Automated Algebraic Multigrid Preconditioner Design Using Genetic Programming for Large-Scale Laser Beam Welding Simulations11 Dec 2024
- 2024Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systems10 Dec 2024
- 2024Multi-Grid Graph Neural Networks with Self-Attention for Computational Mechanics18 Sep 2024
- 2024Algorithm Configuration for Structured Pfaffian Settings6 Sep 2024
- 2024UGrid: An Efficient-And-Rigorous Neural Multigrid Solver for Linear PDEs9 Aug 2024
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations9 Jul 2024
- 2024Accelerating Legacy Numerical Solvers by Non-intrusive Gradient-based Meta-solving5 May 2024
- 2024Neural Multigrid Architectures8 Feb 2024
- 2023Graph Neural Networks and Applied Linear Algebra21 Oct 2023
- 2023Improving Pseudo-Time Stepping Convergence for CFD Simulations With Neural Networks10 Oct 2023
- 2023Learning to Relax: Setting Solver Parameters Across a Sequence of Linear System Instances3 Oct 2023
- 2023Reducing operator complexity in Algebraic Multigrid with Machine Learning Approaches15 Jul 2023
- 2023A Deep Learning algorithm to accelerate Algebraic Multigrid methods in Finite Element solvers of 3D elliptic PDEs21 Apr 2023
- 2023Gauge-equivariant pooling layers for preconditioners in lattice QCD20 Apr 2023
- 2023Invariant preservation in machine learned PDE solvers via error correction28 Mar 2023
- 2023Gauge-equivariant neural networks as preconditioners in lattice QCD10 Feb 2023
- 2023MG-GNN: Multigrid Graph Neural Networks for Learning Multilevel Domain Decomposition Methods26 Jan 2023
- 2022Optimized Sparse Matrix Operations for Reverse Mode Automatic Differentiation10 Dec 2022
- 2022MultiScale MeshGraphNets2 Oct 2022
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solvers28 Aug 2022
- 2022Learning Relaxation for Multigrid25 Jul 2022
- 2022AI-enhanced iterative solvers for accelerating the solution of large scale parametrized systems6 Jul 2022
- 2022Principled Acceleration of Iterative Numerical Methods Using Machine Learning17 Jun 2022
- 2022Generalization Bounds for Data-Driven Numerical Linear Algebra16 Jun 2022
- 2022A Deep Conjugate Direction Method for Iteratively Solving Linear Systems22 May 2022
- 2022Learning Interface Conditions in Domain Decomposition Solvers19 May 2022
- 2022Evolving Generalizable Multigrid-Based Helmholtz Preconditioners with Grammar-Guided Genetic Programming27 Apr 2022
- 2022SoK: Differential Privacy on Graph-Structured Data17 Mar 2022
- 2021Construction of Grid Operators for Multilevel Solvers: a Neural Network Approach13 Sep 2021
- 2021Solving PDEs on Unknown Manifolds with Machine Learning12 Jun 2021
50 newest of 54 All 54 (JSON)
- 2022MultiScale MeshGraphNetscited by 95
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 54
- 2021Reinforcement Learning for Adaptive Mesh Refinementcited by 39
- 2022Generalization Bounds for Data-Driven Numerical Linear Algebracited by 24
- 2021Optimization-Based Algebraic Multigrid Coarsening Using Reinforcement Learningcited by 21
- 2021Learning optimal multigrid smoothers via neural networkscited by 17
- 2021Solving PDEs on Unknown Manifolds with Machine Learningcited by 12
- 2022A Deep Conjugate Direction Method for Iteratively Solving Linear Systemscited by 12
- 2023MG-GNN: Multigrid Graph Neural Networks for Learning Multilevel Domain Decomposition Methodscited by 12
- 2022Learning Interface Conditions in Domain Decomposition Solverscited by 11
- 2024Algorithm Configuration for Structured Pfaffian Settingscited by 11
12 most cited of 52 All 52 (JSON)
- 2026Graph Neural Multilevel Preconditioners for Iterative Solvers30 Jul 2026
- 2026Acceleration of an algebraic multigrid pressure solver using graph neural networks17 Jun 2026
- 2026RAPNet: Accelerating Algebraic Multigrid with Learned Sparse Corrections26 May 2026
- 2026Learning Fill-in Reduction Ordering via Graph Policy Optimization for Sparse Matrices17 May 2026
- 2026Bridging the Gap between Sparse Matrix Reordering and Factorization: A Deep Learning Framework for Fill-in Reduction17 May 2026
- 2026Hybrid Iterative Neural Low-Regularity Integrator for Nonlinear Dispersive Equations6 May 2026
- 2026Automated Grammar-based Algebraic Multigrid Design With Evolutionary Algorithms18 Mar 2026
- 2026Correction of Transformer-Based Models with Smoothing Pseudo-Projector10 Mar 2026
- 2026Neural-HSS: Hierarchical Semi-Separable Neural PDE Solver20 Feb 2026
- 2026NeuraLSP: A Neural Spectral Preconditioner for Accelerating PDE Solvers28 Jan 2026
- 2026torch-sla: Differentiable Sparse Linear Algebra with Adjoint Solvers and Sparse Tensor Parallelism for PyTorch20 Jan 2026
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solvers4 Nov 2025
12 newest of 52 All 52 (JSON)