Implicit Full Waveform Inversion with Deep Neural Representation
Not on the map. Why?
Abstract (arXiv)
Full waveform inversion (FWI) commonly stands for the state-of-the-art approach for imaging subsurface structures and physical parameters, however, its implementation usually faces great challenges, such as building a good initial model to escape from local minima, and evaluating the uncertainty of inversion results. In this paper, we propose the implicit full waveform inversion (IFWI) algorithm using continuously and implicitly defined deep neural representations. Compared to FWI, which is sensitive to the initial model, IFWI benefits from the increased degrees of freedom with deep learning optimization, thus allowing to start from a random initialization, which greatly reduces the risk of non-uniqueness and being trapped in local minima. Both theoretical and experimental analyses indicates that, given a random initial model, IFWI is able to converge to the global minimum and produce a high-resolution image of subsurface with fine structures. In addition, uncertainty analysis of IFWI can be easily performed by approximating Bayesian inference with various deep learning approaches, which is analyzed in this paper by adding dropout neurons. Furthermore, IFWI has a certain degree of robustness and strong generalization ability that are exemplified in the experiments of various 2D geological models. With proper setup, IFWI can also be well suited for multi-scale joint geophysical inversion.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 28 of its 76 references that are in the map. First posted on arXiv 8 Sep 2022.
Builds on
28 of 76 references.
References · 28
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 336
- 2014The Loss Surfaces of Multilayer Networkscited by 278
16 more
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2015Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decompositioncited by 241
- 2018A Convergence Analysis of Gradient Descent for Deep Linear Neural Networkscited by 180
- 2019Pix2Vox: Context-aware 3D Reconstruction from Single and Multi-view Imagescited by 164
- 2020Frequency Bias in Neural Networks for Input of Non-Uniform Densitycited by 140
- 2017Convergence Analysis of Two-layer Neural Networks with ReLU Activationcited by 137
- 2016Matrix Completion has No Spurious Local Minimumcited by 124
- 2016Global Optimality of Local Search for Low Rank Matrix Recoverycited by 81
- 2017SGD Learns Over-parameterized Networks that Provably Generalize on Linearly Separable Datacited by 79
- 2019Hypernetwork functional image representationcited by 65
- 2017Globally Optimal Gradient Descent for a ConvNet with Gaussian Inputscited by 61
- 2017An Analytical Formula of Population Gradient for two-layered ReLU network and its Applications in Convergence and Critical Point Analysiscited by 52
- 2019Deep-learning inversion: a next generation seismic velocity-model building methodcited by 48
- 2019A Machine Learning Benchmark for Facies Classificationcited by 27
- 2021PINNup: Robust neural network wavefield solutions using frequency upscaling and neuron splittingcited by 20
- 2016Total-variation regularization strategies in full-waveform inversioncited by 17
Built on by
Citing papers per year: 2023: 3; 2024: 6; 2025: 9; 2026: 8.
26 papers.
Sort:
By area:
- 2024Controllable seismic velocity synthesis using generative diffusion modelscited by 13
- 2023Microseismic source imaging using physics-informed neural networks with hard constraintscited by 5
- 2024Automatic Differentiation-based Full Waveform Inversion with Flexible Workflowscited by 4
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectivescited by 4
- 2024TAEN: A Model-Constrained Tikhonov Autoencoder Network for Forward and Inverse Problemscited by 3
- 2024ODE-DPS: ODE-based Diffusion Posterior Sampling for Inverse Problems in Partial Differential Equationcited by 2
- 2025Towards Understanding the Benefits of Neural Network Parameterizations in Geophysical Inversions: A Study With Neural Fieldscited by 2
- 2025Initial Model Incorporation for Deep Learning FWI: Pretraining or Denormalization?cited by 2
- 2025Bayesian full waveform inversion with sequential surrogate model refinementcited by 1
- 2025A Differentiable Framework for Full and Phaseless Data Inversion Using Neural Implicit Contrast-Source Representationcited by 1
- 2026Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Frameworkcited by 1
- 2023Overview of Physics-Informed Machine Learning Inversion of Geophysical Datacited by 0
14 more
- 2023IntraSeismic: a coordinate-based learning approach to seismic inversioncited by 0
- 2024Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networkscited by 0
- 2024Survey of Deep Learning and Physics-Based Approaches in Computational Wave Imagingcited by 0
- 2025A new practical and effective source-independent full-waveform inversion with a velocity-distribution supported deep image prior: Applications to two real datasetscited by 0
- 2025Full waveform inversion with CNN-based velocity representation extensioncited by 0
- 2025Inspired by machine learning optimization: can gradient-based optimizers solve cycle skipping in full waveform inversion given sufficient iterations?cited by 0
- 2025Three-dimensional inversion of gravity data using implicit neural representations and scientific machine learningcited by 0
- 2026Self-Flow-Matching assisted Full Waveform Inversioncited by 0
- 2026Total Generalized Variation regularization closes the gap between neural-eld and classical methods in seismic travel-time tomographycited by 0
- 2026Deciphering Neural Reparameterized Full-Waveform Inversion with Neural Sensitivity Kernel and Wave Tangent Kernelcited by 0
- 2026Bayesian three-dimensional seismic travel-time tomography for active- and passive-source seismic data using physics-informed neural networkcited by 0
- 2026Tensor Train Decomposition-based 3D Implicit Full Waveform Inversion with Multi-scale Structural Similaritycited by 0
- 2026An automatic-differentiation framework for time-lapse electrical resistivity tomography inversion of hydrologic dynamicscited by 0
- 2026Image Fidelity is Not Field Fidelity: Joint Thermodynamic Reconstruction and Error Localization in Neural Tomographycited by 0
- 2026Image Fidelity is Not Field Fidelity: Joint Thermodynamic Reconstruction and Error Localization in Neural Tomography24 Sep 2026
- 2026An automatic-differentiation framework for time-lapse electrical resistivity tomography inversion of hydrologic dynamics31 Jul 2026
- 2026Tensor Train Decomposition-based 3D Implicit Full Waveform Inversion with Multi-scale Structural Similarity22 Jun 2026
- 2026Bayesian three-dimensional seismic travel-time tomography for active- and passive-source seismic data using physics-informed neural network19 Jun 2026
- 2026Deciphering Neural Reparameterized Full-Waveform Inversion with Neural Sensitivity Kernel and Wave Tangent Kernel14 May 2026
- 2026Total Generalized Variation regularization closes the gap between neural-eld and classical methods in seismic travel-time tomography11 May 2026
- 2026Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Framework23 Mar 2026
- 2026Self-Flow-Matching assisted Full Waveform Inversion13 Mar 2026
- 2025Three-dimensional inversion of gravity data using implicit neural representations and scientific machine learning17 Oct 2025
- 2025Inspired by machine learning optimization: can gradient-based optimizers solve cycle skipping in full waveform inversion given sufficient iterations?18 Sep 2025
- 2025A Differentiable Framework for Full and Phaseless Data Inversion Using Neural Implicit Contrast-Source Representation14 Aug 2025
- 2025Initial Model Incorporation for Deep Learning FWI: Pretraining or Denormalization?5 Jun 2025
14 more
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectives21 May 2025
- 2025Bayesian full waveform inversion with sequential surrogate model refinement6 May 2025
- 2025Full waveform inversion with CNN-based velocity representation extension22 Apr 2025
- 2025Towards Understanding the Benefits of Neural Network Parameterizations in Geophysical Inversions: A Study With Neural Fields21 Mar 2025
- 2025A new practical and effective source-independent full-waveform inversion with a velocity-distribution supported deep image prior: Applications to two real datasets1 Mar 2025
- 2024TAEN: A Model-Constrained Tikhonov Autoencoder Network for Forward and Inverse Problems9 Dec 2024
- 2024Automatic Differentiation-based Full Waveform Inversion with Flexible Workflows30 Nov 2024
- 2024Survey of Deep Learning and Physics-Based Approaches in Computational Wave Imaging10 Oct 2024
- 2024Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networks27 May 2024
- 2024ODE-DPS: ODE-based Diffusion Posterior Sampling for Inverse Problems in Partial Differential Equation21 Apr 2024
- 2024Controllable seismic velocity synthesis using generative diffusion models9 Feb 2024
- 2023IntraSeismic: a coordinate-based learning approach to seismic inversion17 Dec 2023
- 2023Overview of Physics-Informed Machine Learning Inversion of Geophysical Data12 Oct 2023
- 2023Microseismic source imaging using physics-informed neural networks with hard constraints9 Apr 2023
- 2023Microseismic source imaging using physics-informed neural networks with hard constraintscited by 5
- 2024Automatic Differentiation-based Full Waveform Inversion with Flexible Workflowscited by 4
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectivescited by 4
- 2024TAEN: A Model-Constrained Tikhonov Autoencoder Network for Forward and Inverse Problemscited by 3
- 2024ODE-DPS: ODE-based Diffusion Posterior Sampling for Inverse Problems in Partial Differential Equationcited by 2
- 2025Towards Understanding the Benefits of Neural Network Parameterizations in Geophysical Inversions: A Study With Neural Fieldscited by 2
- 2025Initial Model Incorporation for Deep Learning FWI: Pretraining or Denormalization?cited by 2
- 2025Bayesian full waveform inversion with sequential surrogate model refinementcited by 1
- 2025A Differentiable Framework for Full and Phaseless Data Inversion Using Neural Implicit Contrast-Source Representationcited by 1
- 2026Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Frameworkcited by 1
- 2023Overview of Physics-Informed Machine Learning Inversion of Geophysical Datacited by 0
- 2023IntraSeismic: a coordinate-based learning approach to seismic inversioncited by 0
12 most cited of 24 All 24 (JSON)
- 2026Image Fidelity is Not Field Fidelity: Joint Thermodynamic Reconstruction and Error Localization in Neural Tomography24 Sep 2026
- 2026An automatic-differentiation framework for time-lapse electrical resistivity tomography inversion of hydrologic dynamics31 Jul 2026
- 2026Tensor Train Decomposition-based 3D Implicit Full Waveform Inversion with Multi-scale Structural Similarity22 Jun 2026
- 2026Bayesian three-dimensional seismic travel-time tomography for active- and passive-source seismic data using physics-informed neural network19 Jun 2026
- 2026Deciphering Neural Reparameterized Full-Waveform Inversion with Neural Sensitivity Kernel and Wave Tangent Kernel14 May 2026
- 2026Total Generalized Variation regularization closes the gap between neural-eld and classical methods in seismic travel-time tomography11 May 2026
- 2026Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Framework23 Mar 2026
- 2025Three-dimensional inversion of gravity data using implicit neural representations and scientific machine learning17 Oct 2025
- 2025Inspired by machine learning optimization: can gradient-based optimizers solve cycle skipping in full waveform inversion given sufficient iterations?18 Sep 2025
- 2025A Differentiable Framework for Full and Phaseless Data Inversion Using Neural Implicit Contrast-Source Representation14 Aug 2025
- 2025Initial Model Incorporation for Deep Learning FWI: Pretraining or Denormalization?5 Jun 2025
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectives21 May 2025
12 newest of 24 All 24 (JSON)