Multigrid-augmented deep learning preconditioners for the Helmholtz equation
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a data-driven approach to iteratively solve the discrete heterogeneous Helmholtz equation at high wavenumbers. In our approach, we combine classical iterative solvers with convolutional neural networks (CNNs) to form a preconditioner which is applied within a Krylov solver. For the preconditioner, we use a CNN of type U-Net that operates in conjunction with multigrid ingredients. Two types of preconditioners are proposed 1) U-Net as a coarse grid solver, and 2) U-Net as a deflation operator with shifted Laplacian V-cycles. Following our training scheme and data-augmentation, our CNN preconditioner can generalize over residuals and a relatively general set of wave slowness models. On top of that, we also offer an encoder-solver framework where an "encoder" network generalizes over the medium and sends context vectors to another "solver" network, which generalizes over the right-hand-sides. We show that this option is more robust and efficient than the stand-alone variant. Lastly, we also offer a mini-retraining procedure, to improve the solver after the model is known. This option is beneficial when solving multiple right-hand-sides, like in inverse problems. We demonstrate the efficiency and generalization abilities of our approach on a variety of 2D problems.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 14 of its 51 references that are in the map. First posted on arXiv 14 Mar 2022.
Builds on
14 of 51 references.
References · 14
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2019DeepXDE: A deep learning library for solving differential equationscited by 619
- 2017Solving high-dimensional partial differential equations using deep learningcited by 556
- 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
- 2019Deep neural network solution of the electronic Schr"odinger equationcited by 127
- 2019Learning to Optimize Multigrid PDE Solverscited by 79
- 2020CFDNet: a deep learning-based accelerator for fluid simulationscited by 40
- 2018SwitchNet: a neural network model for forward and inverse scattering problemscited by 35
- 2020Numerical Solution of the Parametric Diffusion Equation by Deep Neural Networkscited by 27
Built on by
Citing papers per year: 2022: 3; 2023: 4; 2024: 8; 2025: 6; 2026: 4.
25 papers.
Sort:
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 54
- 2023Neural incomplete factorization: learning preconditioners for the conjugate gradient methodcited by 18
- 2024Learning from Linear Algebra: A Graph Neural Network Approach to Preconditioner Design for Conjugate Gradient Solverscited by 15
- 2023Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation using Compact Implicit Layerscited by 11
- 2024Neural Green's Operators for Parametric Partial Differential Equationscited by 11
- 2022j-Wave: An open-source differentiable wave simulatorcited by 9
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solverscited by 9
- 2022Principled Acceleration of Iterative Numerical Methods Using Machine Learningcited by 6
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Methodcited by 6
- 2025Accurate and scalable deep Maxwell solvers using multilevel iterative methodscited by 5
- 2025Universal Fourier Neural Operators for periodic homogenization problems in linear elasticitycited by 3
13 more
- 2025Self-composing neural operators for high-frequency and multiscale PDE surrogatescited by 3
- 2023A Neural-preconditioned Poisson Solver for Mixed Dirichlet and Neumann Boundary Conditionscited by 2
- 2024Generative modeling of Sparse Approximate Inverse Preconditionerscited by 2
- 2024End-to-End Mesh Optimization of a Hybrid Deep Learning Black-Box PDE Solvercited by 1
- 2024Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systemscited by 1
- 2023Improving Pseudo-Time Stepping Convergence for CFD Simulations With Neural Networkscited by 0
- 2024Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networkscited by 0
- 2024Adaptive Error-Bounded Hierarchical Matrices for Efficient Neural Network Compressioncited by 0
- 2025Matrix-free Neural Preconditioner for the Dirac Operator in Lattice Gauge Theorycited by 0
- 2026IV-Net: A neural network for elliptic PDEs with random and highly varying coefficientscited by 0
- 2026RAPNet: Accelerating Algebraic Multigrid with Learned Sparse Correctionscited by 0
- 2026Inductively Scalable, Single-Step Neural Surrogates for Wave-Scattering Inverse Problemscited by 0
- 2026Neural Network Preconditioning: A Case Study for the Solution of the Parametric Helmholtz Equationcited by 0
- 2026Neural Network Preconditioning: A Case Study for the Solution of the Parametric Helmholtz Equation12 Oct 2026
- 2026Inductively Scalable, Single-Step Neural Surrogates for Wave-Scattering Inverse Problems18 Aug 2026
- 2026RAPNet: Accelerating Algebraic Multigrid with Learned Sparse Corrections26 May 2026
- 2026IV-Net: A neural network for elliptic PDEs with random and highly varying coefficients24 May 2026
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solvers4 Nov 2025
- 2025Matrix-free Neural Preconditioner for the Dirac Operator in Lattice Gauge Theory12 Sep 2025
- 2025Accurate and scalable deep Maxwell solvers using multilevel iterative methods3 Sep 2025
- 2025Self-composing neural operators for high-frequency and multiscale PDE surrogates28 Aug 2025
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Method31 Jul 2025
- 2025Universal Fourier Neural Operators for periodic homogenization problems in linear elasticity16 Jul 2025
- 2024Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systems10 Dec 2024
- 2024Adaptive Error-Bounded Hierarchical Matrices for Efficient Neural Network Compression11 Sep 2024
13 more
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations9 Jul 2024
- 2024Neural Green's Operators for Parametric Partial Differential Equations4 Jun 2024
- 2024Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networks27 May 2024
- 2024Learning from Linear Algebra: A Graph Neural Network Approach to Preconditioner Design for Conjugate Gradient Solvers24 May 2024
- 2024Generative modeling of Sparse Approximate Inverse Preconditioners17 May 2024
- 2024End-to-End Mesh Optimization of a Hybrid Deep Learning Black-Box PDE Solver17 Apr 2024
- 2023Improving Pseudo-Time Stepping Convergence for CFD Simulations With Neural Networks10 Oct 2023
- 2023A Neural-preconditioned Poisson Solver for Mixed Dirichlet and Neumann Boundary Conditions29 Sep 2023
- 2023Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation using Compact Implicit Layers30 Jun 2023
- 2023Neural incomplete factorization: learning preconditioners for the conjugate gradient method25 May 2023
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solvers28 Aug 2022
- 2022j-Wave: An open-source differentiable wave simulator30 Jun 2022
- 2022Principled Acceleration of Iterative Numerical Methods Using Machine Learning17 Jun 2022
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 54
- 2023Neural incomplete factorization: learning preconditioners for the conjugate gradient methodcited by 18
- 2024Learning from Linear Algebra: A Graph Neural Network Approach to Preconditioner Design for Conjugate Gradient Solverscited by 15
- 2023Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation using Compact Implicit Layerscited by 11
- 2024Neural Green's Operators for Parametric Partial Differential Equationscited by 11
- 2022j-Wave: An open-source differentiable wave simulatorcited by 9
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solverscited by 9
- 2022Principled Acceleration of Iterative Numerical Methods Using Machine Learningcited by 6
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Methodcited by 6
- 2025Accurate and scalable deep Maxwell solvers using multilevel iterative methodscited by 5
- 2025Universal Fourier Neural Operators for periodic homogenization problems in linear elasticitycited by 3
12 most cited of 25 All 25 (JSON)
- 2026Neural Network Preconditioning: A Case Study for the Solution of the Parametric Helmholtz Equation12 Oct 2026
- 2026Inductively Scalable, Single-Step Neural Surrogates for Wave-Scattering Inverse Problems18 Aug 2026
- 2026RAPNet: Accelerating Algebraic Multigrid with Learned Sparse Corrections26 May 2026
- 2026IV-Net: A neural network for elliptic PDEs with random and highly varying coefficients24 May 2026
- 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solvers4 Nov 2025
- 2025Matrix-free Neural Preconditioner for the Dirac Operator in Lattice Gauge Theory12 Sep 2025
- 2025Accurate and scalable deep Maxwell solvers using multilevel iterative methods3 Sep 2025
- 2025Self-composing neural operators for high-frequency and multiscale PDE surrogates28 Aug 2025
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Method31 Jul 2025
- 2025Universal Fourier Neural Operators for periodic homogenization problems in linear elasticity16 Jul 2025
- 2024Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systems10 Dec 2024
- 2024Adaptive Error-Bounded Hierarchical Matrices for Efficient Neural Network Compression11 Sep 2024
12 newest of 25 All 25 (JSON)