mlsanityData to 14 Oct 2026

Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation using Compact Implicit Layers

arXiv 2306.17486 ↗First posted 30 Jun 2023cs.LG cs.CEcited by 11

Not on the map. Why?

Abstract (arXiv)

We present a deep learning-based iterative approach to solve the discrete heterogeneous Helmholtz equation for high wavenumbers. Combining classical iterative multigrid solvers and convolutional neural networks (CNNs) via preconditioning, we obtain a learned neural solver that is faster and scales better than a standard multigrid solver. Our approach offers three main contributions over previous neural methods of this kind. First, we construct a multilevel U-Net-like encoder-solver CNN with an implicit layer on the coarsest grid of the U-Net, where convolution kernels are inverted. This alleviates the field of view problem in CNNs and allows better scalability. Second, we improve upon the previous CNN preconditioner in terms of the number of parameters, computation time, and convergence rates. Third, we propose a multiscale training approach that enables the network to scale to problems of previously unseen dimensions while still maintaining a reasonable training procedure. Our encoder-solver architecture can be used to generalize over different slowness models of various difficulties and is efficient at solving for many right-hand sides per slowness model. We demonstrate the benefits of our novel architecture with numerical experiments on a variety of heterogeneous two-dimensional problems at high wavenumbers.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 35 of its 78 references that are in the map. First posted on arXiv 30 Jun 2023.

Builds on

35 of 78 references.

References · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  6. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  7. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
  8. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  9. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  10. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  11. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  12. 2018On the Spectral Bias of Neural Networkscited by 1,341
23 more
  1. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
  2. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 678
  3. 2019DeepXDE: A deep learning library for solving differential equationscited by 619
  4. 2017Solving high-dimensional partial differential equations using deep learningcited by 556
  5. 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
  6. 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 205
  7. 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
  8. 2016A guide to convolution arithmetic for deep learningcited by 185
  9. 2021Activation Functions in Deep Learning: A Comprehensive Survey and Benchmarkcited by 155
  10. 2022Learning Operators with Coupled Attentioncited by 90
  11. 2019Learning to Optimize Multigrid PDE Solverscited by 79
  12. 2019Learning Neural PDE Solvers with Convergence Guaranteescited by 77
  13. 2020A physics-informed operator regression framework for extracting data-driven continuum modelscited by 60
  14. 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 54
  15. 2021OpenFWI: Large-Scale Multi-Structural Benchmark Datasets for Seismic Full Waveform Inversioncited by 44
  16. 2020CFDNet: a deep learning-based accelerator for fluid simulationscited by 40
  17. 2018SwitchNet: a neural network model for forward and inverse scattering problemscited by 35
  18. 2022Multigrid-augmented deep learning preconditioners for the Helmholtz equationcited by 25
  19. 2019IMEXnet: A Forward Stable Deep Neural Networkcited by 22
  20. 2020A Helmholtz equation solver using unsupervised learning: Application to transcranial ultrasoundcited by 12
  21. 2017Efficient Inversion of Multiple-Scattering Model for Optical Diffraction Tomographycited by 6
  22. 2019Three-Dimensional Optical Diffraction Tomography with Lippmann-Schwinger Modelcited by 3
  23. 2017A multigrid solver to the Helmholtz equation with a point source based on travel time and amplitudecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 4.

11 papers.