mlsanityData to 7 Oct 2026

Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Framework

arXiv 2603.22362 ↗First posted 23 Mar 2026cs.LG cs.AI physics.geo-phcited by 1

Not on the map. Why?

Abstract (arXiv)

Full-waveform inversion (FWI) estimates physical parameters in the wave equation from limited measurements and has been widely applied in geophysical exploration, medical imaging, and non-destructive testing. Conventional FWI methods are limited by their notorious sensitivity to the accuracy of the initial models. Recent progress in continuous representation FWI (CR-FWI) demonstrates that representing parameter models with a coordinate-based neural network, such as implicit neural representation (INR), can mitigate the dependence on initial models. However, its underlying mechanism remains unclear, and INR-based FWI shows slower high-frequency convergence. In this work, we investigate the general CR-FWI framework and develop a unified theoretical understanding by extending the neural tangent kernel (NTK) for FWI to establish a wave-based NTK framework. Unlike standard NTK, our analysis reveals that wave-based NTK is not constant, both at initialization and during training, due to the inherent nonlinearity of FWI. We further show that the eigenvalue decay behavior of the wave-based NTK can explain why CR-FWI alleviates the dependency on initial models and shows slower high-frequency convergence. Building on these insights, we propose several CR-FWI methods with tailored eigenvalue decay properties for FWI, including a novel hybrid representation combining INR and multi-resolution grid (termed IG-FWI) that achieves a more balanced trade-off between robustness and high-frequency convergence rate. Applications in geophysical exploration on Marmousi, 2D SEG/EAGE Salt and Overthrust, 2004 BP model, and the more realistic 2014 Chevron models show the superior performance of our proposed methods compared to conventional FWI and existing INR-based FWI methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 86 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

34 of 86 references.

References · 34

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  2. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
  3. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  4. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  5. 2019Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networkscited by 562
  6. 2020Loss landscapes and optimization in over-parameterized non-linear systems and neural networkscited by 231
  7. 2023WIRE: Wavelet Implicit Neural Representationscited by 220
  8. 2019On the Inductive Bias of Neural Tangent Kernelscited by 177
  9. 2019Towards Understanding the Spectral Bias of Deep Learningcited by 173
  10. 2020On the linearity of large non-linear models: when and why the tangent kernel is constantcited by 129
  11. 2022Overview frequency principle/spectral bias in deep learningcited by 68
  12. 2020The Recurrent Neural Tangent Kernelcited by 67
22 more
  1. 2025InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciencescited by 67
  2. 2018InversionNet: A Real-Time and Accurate Full Waveform Inversion with CNNs and continuous CRFscited by 60
  3. 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
  4. 2022Low-Rank Tensor Function Representation for Multi-Dimensional Data Recoverycited by 45
  5. 2021OpenFWI: Large-Scale Multi-Structural Benchmark Datasets for Seismic Full Waveform Inversioncited by 44
  6. 2021Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loopcited by 29
  7. 2022Implicit Full Waveform Inversion with Deep Neural Representationcited by 26
  8. 2024Toward a Better Understanding of Fourier Neural Operators from a Spectral Perspectivecited by 24
  9. 2024The Challenges of the Nonlinear Regime for Physics-Informed Neural Networkscited by 21
  10. 2016Total-variation regularization strategies in full-waveform inversioncited by 17
  11. 2024Optimal Convergence Rates for Neural Operatorscited by 7
  12. 2020Optimal Transport Based Seismic Inversion: Beyond Cycle Skippingcited by 6
  13. 2023On the Use of Neural Networks for Full Waveform Inversioncited by 5
  14. 2024A Unified Framework for Forward and Inverse Problems in Subsurface Imaging using Latent Space Translationscited by 5
  15. 2024Is the neural tangent kernel of PINNs deep learning general partial differential equations always convergent ?cited by 5
  16. 2024Automatic Differentiation-based Full Waveform Inversion with Flexible Workflowscited by 4
  17. 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectivescited by 4
  18. 2025Neural Tangent Kernel of Neural Networks with Loss Informed by Differential Operatorscited by 3
  19. 2025Divergence of Empirical Neural Tangent Kernel in Classification Problemscited by 3
  20. 2025How Learnable Grids Recover Fine Detail in Low Dimensions: A Neural Tangent Kernel Analysis of Multigrid Parametric Encodingscited by 3
  21. 2024Convergence analysis of wide shallow neural operators within the framework of Neural Tangent Kernelcited by 2
  22. 2025Initial Model Incorporation for Deep Learning FWI: Pretraining or Denormalization?cited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.