Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation using Compact Implicit Layers
Not on the map. Why?
Abstract (arXiv)
We present a deep learning-based iterative approach to solve the discrete heterogeneous Helmholtz equation for high wavenumbers. Combining classical iterative multigrid solvers and convolutional neural networks (CNNs) via preconditioning, we obtain a learned neural solver that is faster and scales better than a standard multigrid solver. Our approach offers three main contributions over previous neural methods of this kind. First, we construct a multilevel U-Net-like encoder-solver CNN with an implicit layer on the coarsest grid of the U-Net, where convolution kernels are inverted. This alleviates the field of view problem in CNNs and allows better scalability. Second, we improve upon the previous CNN preconditioner in terms of the number of parameters, computation time, and convergence rates. Third, we propose a multiscale training approach that enables the network to scale to problems of previously unseen dimensions while still maintaining a reasonable training procedure. Our encoder-solver architecture can be used to generalize over different slowness models of various difficulties and is efficient at solving for many right-hand sides per slowness model. We demonstrate the benefits of our novel architecture with numerical experiments on a variety of heterogeneous two-dimensional problems at high wavenumbers.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 35 of its 78 references that are in the map. First posted on arXiv 30 Jun 2023.
Builds on
35 of 78 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2018On the Spectral Bias of Neural Networkscited by 1,341
23 more
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 678
- 2019DeepXDE: A deep learning library for solving differential equationscited by 619
- 2017Solving high-dimensional partial differential equations using deep learningcited by 556
- 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
- 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 205
- 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
- 2016A guide to convolution arithmetic for deep learningcited by 185
- 2021Activation Functions in Deep Learning: A Comprehensive Survey and Benchmarkcited by 155
- 2022Learning Operators with Coupled Attentioncited by 90
- 2019Learning to Optimize Multigrid PDE Solverscited by 79
- 2019Learning Neural PDE Solvers with Convergence Guaranteescited by 77
- 2020A physics-informed operator regression framework for extracting data-driven continuum modelscited by 60
- 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 54
- 2021OpenFWI: Large-Scale Multi-Structural Benchmark Datasets for Seismic Full Waveform Inversioncited by 44
- 2020CFDNet: a deep learning-based accelerator for fluid simulationscited by 40
- 2018SwitchNet: a neural network model for forward and inverse scattering problemscited by 35
- 2022Multigrid-augmented deep learning preconditioners for the Helmholtz equationcited by 25
- 2019IMEXnet: A Forward Stable Deep Neural Networkcited by 22
- 2020A Helmholtz equation solver using unsupervised learning: Application to transcranial ultrasoundcited by 12
- 2017Efficient Inversion of Multiple-Scattering Model for Optical Diffraction Tomographycited by 6
- 2019Three-Dimensional Optical Diffraction Tomography with Lippmann-Schwinger Modelcited by 3
- 2017A multigrid solver to the Helmholtz equation with a point source based on travel time and amplitudecited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 4.
11 papers.
- 2024Neural Green's Operators for Parametric Partial Differential Equationscited by 11
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Methodcited by 6
- 2025Accurate and scalable deep Maxwell solvers using multilevel iterative methodscited by 5
- 2025Self-composing neural operators for high-frequency and multiscale PDE surrogatescited by 3
- 2025MD-PNOP: Equation-Recast Neural Operators for Minimal-Data Extrapolation and PDE Solver Accelerationcited by 2
- 2025Learning Greens Operators through Hierarchical Neural Networks Inspired by the Fast Multipole Methodcited by 2
- 2024Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networkscited by 0
- 2026Learning to Discover Iterative Spectral Algorithmscited by 0
- 2026RAPNet: Accelerating Algebraic Multigrid with Learned Sparse Correctionscited by 0
- 2026McMg: A Learned Phase-Space Multi-channel Multigrid Preconditioner for Helmholtz Equationcited by 0
- 2026Inductively Scalable, Single-Step Neural Surrogates for Wave-Scattering Inverse Problemscited by 0
- 2026Inductively Scalable, Single-Step Neural Surrogates for Wave-Scattering Inverse Problems18 Aug 2026
- 2026McMg: A Learned Phase-Space Multi-channel Multigrid Preconditioner for Helmholtz Equation29 Jun 2026
- 2026RAPNet: Accelerating Algebraic Multigrid with Learned Sparse Corrections26 May 2026
- 2026Learning to Discover Iterative Spectral Algorithms10 Feb 2026
- 2025Learning Greens Operators through Hierarchical Neural Networks Inspired by the Fast Multipole Method24 Sep 2025
- 2025Accurate and scalable deep Maxwell solvers using multilevel iterative methods3 Sep 2025
- 2025MD-PNOP: Equation-Recast Neural Operators for Minimal-Data Extrapolation and PDE Solver Acceleration1 Sep 2025
- 2025Self-composing neural operators for high-frequency and multiscale PDE surrogates28 Aug 2025
- 2025Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Method31 Jul 2025
- 2024Neural Green's Operators for Parametric Partial Differential Equations4 Jun 2024
- 2024Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networks27 May 2024