Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Framework
Not on the map. Why?
Abstract (arXiv)
Full-waveform inversion (FWI) estimates physical parameters in the wave equation from limited measurements and has been widely applied in geophysical exploration, medical imaging, and non-destructive testing. Conventional FWI methods are limited by their notorious sensitivity to the accuracy of the initial models. Recent progress in continuous representation FWI (CR-FWI) demonstrates that representing parameter models with a coordinate-based neural network, such as implicit neural representation (INR), can mitigate the dependence on initial models. However, its underlying mechanism remains unclear, and INR-based FWI shows slower high-frequency convergence. In this work, we investigate the general CR-FWI framework and develop a unified theoretical understanding by extending the neural tangent kernel (NTK) for FWI to establish a wave-based NTK framework. Unlike standard NTK, our analysis reveals that wave-based NTK is not constant, both at initialization and during training, due to the inherent nonlinearity of FWI. We further show that the eigenvalue decay behavior of the wave-based NTK can explain why CR-FWI alleviates the dependency on initial models and shows slower high-frequency convergence. Building on these insights, we propose several CR-FWI methods with tailored eigenvalue decay properties for FWI, including a novel hybrid representation combining INR and multi-resolution grid (termed IG-FWI) that achieves a more balanced trade-off between robustness and high-frequency convergence rate. Applications in geophysical exploration on Marmousi, 2D SEG/EAGE Salt and Overthrust, 2004 BP model, and the more realistic 2014 Chevron models show the superior performance of our proposed methods compared to conventional FWI and existing INR-based FWI methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 86 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
34 of 86 references.
References · 34
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2019Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networkscited by 562
- 2020Loss landscapes and optimization in over-parameterized non-linear systems and neural networkscited by 231
- 2023WIRE: Wavelet Implicit Neural Representationscited by 220
- 2019On the Inductive Bias of Neural Tangent Kernelscited by 177
- 2019Towards Understanding the Spectral Bias of Deep Learningcited by 173
- 2020On the linearity of large non-linear models: when and why the tangent kernel is constantcited by 129
- 2022Overview frequency principle/spectral bias in deep learningcited by 68
- 2020The Recurrent Neural Tangent Kernelcited by 67
22 more
- 2025InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciencescited by 67
- 2018InversionNet: A Real-Time and Accurate Full Waveform Inversion with CNNs and continuous CRFscited by 60
- 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
- 2022Low-Rank Tensor Function Representation for Multi-Dimensional Data Recoverycited by 45
- 2021OpenFWI: Large-Scale Multi-Structural Benchmark Datasets for Seismic Full Waveform Inversioncited by 44
- 2021Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loopcited by 29
- 2022Implicit Full Waveform Inversion with Deep Neural Representationcited by 26
- 2024Toward a Better Understanding of Fourier Neural Operators from a Spectral Perspectivecited by 24
- 2024The Challenges of the Nonlinear Regime for Physics-Informed Neural Networkscited by 21
- 2016Total-variation regularization strategies in full-waveform inversioncited by 17
- 2024Optimal Convergence Rates for Neural Operatorscited by 7
- 2020Optimal Transport Based Seismic Inversion: Beyond Cycle Skippingcited by 6
- 2023On the Use of Neural Networks for Full Waveform Inversioncited by 5
- 2024A Unified Framework for Forward and Inverse Problems in Subsurface Imaging using Latent Space Translationscited by 5
- 2024Is the neural tangent kernel of PINNs deep learning general partial differential equations always convergent ?cited by 5
- 2024Automatic Differentiation-based Full Waveform Inversion with Flexible Workflowscited by 4
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectivescited by 4
- 2025Neural Tangent Kernel of Neural Networks with Loss Informed by Differential Operatorscited by 3
- 2025Divergence of Empirical Neural Tangent Kernel in Classification Problemscited by 3
- 2025How Learnable Grids Recover Fine Detail in Low Dimensions: A Neural Tangent Kernel Analysis of Multigrid Parametric Encodingscited by 3
- 2024Convergence analysis of wide shallow neural operators within the framework of Neural Tangent Kernelcited by 2
- 2025Initial Model Incorporation for Deep Learning FWI: Pretraining or Denormalization?cited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.