mlsanityData to 14 Oct 2026

Multigrid-augmented deep learning preconditioners for the Helmholtz equation

arXiv 2203.11025 ↗First posted 14 Mar 2022math.NA cs.CE cs.LGcited by 25

Not on the map. Why?

Abstract (arXiv)

In this paper, we present a data-driven approach to iteratively solve the discrete heterogeneous Helmholtz equation at high wavenumbers. In our approach, we combine classical iterative solvers with convolutional neural networks (CNNs) to form a preconditioner which is applied within a Krylov solver. For the preconditioner, we use a CNN of type U-Net that operates in conjunction with multigrid ingredients. Two types of preconditioners are proposed 1) U-Net as a coarse grid solver, and 2) U-Net as a deflation operator with shifted Laplacian V-cycles. Following our training scheme and data-augmentation, our CNN preconditioner can generalize over residuals and a relatively general set of wave slowness models. On top of that, we also offer an encoder-solver framework where an "encoder" network generalizes over the medium and sends context vectors to another "solver" network, which generalizes over the right-hand-sides. We show that this option is more robust and efficient than the stand-alone variant. Lastly, we also offer a mini-retraining procedure, to improve the solver after the model is known. This option is beneficial when solving multiple right-hand-sides, like in inverse problems. We demonstrate the efficiency and generalization abilities of our approach on a variety of 2D problems.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 14 of its 51 references that are in the map. First posted on arXiv 14 Mar 2022.

Builds on

14 of 51 references.

References · 14

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  5. 2019DeepXDE: A deep learning library for solving differential equationscited by 619
  6. 2017Solving high-dimensional partial differential equations using deep learningcited by 556
  7. 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
  8. 2019Deep neural network solution of the electronic Schr"odinger equationcited by 127
  9. 2019Learning to Optimize Multigrid PDE Solverscited by 79
  10. 2020CFDNet: a deep learning-based accelerator for fluid simulationscited by 40
  11. 2018SwitchNet: a neural network model for forward and inverse scattering problemscited by 35
  12. 2020Numerical Solution of the Parametric Diffusion Equation by Deep Neural Networkscited by 27
2 more
  1. 2020DiffGCN: Graph Convolutional Networks via Differential Operators and Algebraic Multigrid Poolingcited by 17
  2. 2017A multigrid solver to the Helmholtz equation with a point source based on travel time and amplitudecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 3; 2023: 4; 2024: 8; 2025: 6; 2026: 4.

25 papers.

Sort:

  1. 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
  2. 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 54
  3. 2023Neural incomplete factorization: learning preconditioners for the conjugate gradient methodcited by 18
  4. 2024Learning from Linear Algebra: A Graph Neural Network Approach to Preconditioner Design for Conjugate Gradient Solverscited by 15
  5. 2023Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation using Compact Implicit Layerscited by 11
  6. 2024Neural Green's Operators for Parametric Partial Differential Equationscited by 11
  7. 2022j-Wave: An open-source differentiable wave simulatorcited by 9
  8. 2025NOWS: Neural Operator Warm Starts for Accelerating Iterative Solverscited by 9
  9. 2022Principled Acceleration of Iterative Numerical Methods Using Machine Learningcited by 6
  10. 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Methodcited by 6
  11. 2025Accurate and scalable deep Maxwell solvers using multilevel iterative methodscited by 5
  12. 2025Universal Fourier Neural Operators for periodic homogenization problems in linear elasticitycited by 3
13 more
  1. 2025Self-composing neural operators for high-frequency and multiscale PDE surrogatescited by 3
  2. 2023A Neural-preconditioned Poisson Solver for Mixed Dirichlet and Neumann Boundary Conditionscited by 2
  3. 2024Generative modeling of Sparse Approximate Inverse Preconditionerscited by 2
  4. 2024End-to-End Mesh Optimization of a Hybrid Deep Learning Black-Box PDE Solvercited by 1
  5. 2024Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systemscited by 1
  6. 2023Improving Pseudo-Time Stepping Convergence for CFD Simulations With Neural Networkscited by 0
  7. 2024Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networkscited by 0
  8. 2024Adaptive Error-Bounded Hierarchical Matrices for Efficient Neural Network Compressioncited by 0
  9. 2025Matrix-free Neural Preconditioner for the Dirac Operator in Lattice Gauge Theorycited by 0
  10. 2026IV-Net: A neural network for elliptic PDEs with random and highly varying coefficientscited by 0
  11. 2026RAPNet: Accelerating Algebraic Multigrid with Learned Sparse Correctionscited by 0
  12. 2026Inductively Scalable, Single-Step Neural Surrogates for Wave-Scattering Inverse Problemscited by 0
  13. 2026Neural Network Preconditioning: A Case Study for the Solution of the Parametric Helmholtz Equationcited by 0