Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systems
Not on the map. Why?
Abstract (arXiv)
Preconditioning techniques are crucial for enhancing the efficiency of solving large-scale linear equation systems that arise from partial differential equation (PDE) discretization. These techniques, such as Incomplete Cholesky factorization (IC) and data-driven neural network methods, accelerate the convergence of iterative solvers like Conjugate Gradient (CG) by approximating the original matrices. This paper introduces a novel approach that integrates Graph Neural Network (GNN) with traditional IC, addressing the shortcomings of direct generation methods based on GNN and achieving significant improvements in computational efficiency and scalability. Experimental results demonstrate an average reduction in iteration counts by 24.8% compared to IC and a two-order-of-magnitude increase in training scale compared to previous methods. A three-dimensional static structural analysis utilizing finite element methods was validated on training sparse matrices of up to 5 million dimensions and inference scales of up to 10 million. Furthermore, the approach demon-strates robust generalization capabilities across scales, facilitating the effective acceleration of CG solvers for large-scale linear equations using small-scale data on modest hardware. The method's robustness and scalability make it a practical solution for computational science.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 30 references that are in the map. First posted on arXiv 10 Dec 2024.
Builds on
10 of 30 references.
References · 10
- 2017Attention Is All You Needcited by 59,932
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
- 2020Learning Algebraic Multigrid Using Graph Neural Networkscited by 54
- 2022Multigrid-augmented deep learning preconditioners for the Helmholtz equationcited by 24
- 2019Deep Learning of Preconditioners for Conjugate Gradient Solvers in Urban Water Related Problemscited by 19
- 2023Graph Neural Networks and Applied Linear Algebracited by 6
- 2022Optimized Sparse Matrix Operations for Reverse Mode Automatic Differentiationcited by 5
Built on by
Not cited yet.