Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop
Not on the map. Why?
Abstract (arXiv)
This paper investigates unsupervised learning of Full-Waveform Inversion (FWI), which has been widely used in geophysics to estimate subsurface velocity maps from seismic data. This problem is mathematically formulated by a second order partial differential equation (PDE), but is hard to solve. Moreover, acquiring velocity map is extremely expensive, making it impractical to scale up a supervised approach to train the mapping from seismic data to velocity maps with convolutional neural networks (CNN). We address these difficulties by integrating PDE and CNN in a loop, thus shifting the paradigm to unsupervised learning that only requires seismic data. In particular, we use finite difference to approximate the forward modeling of PDE as a differentiable operator (from velocity map to seismic data) and model its inversion by CNN (from seismic data to velocity map). Hence, we transform the supervised inversion task into an unsupervised seismic data reconstruction task. We also introduce a new large-scale dataset OpenFWI, to establish a more challenging benchmark for the community. Experiment results show that our model (using seismic data alone) yields comparable accuracy to the supervised counterpart (using both seismic data and velocity map). Furthermore, it outperforms the supervised model when involving more seismic data.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 12 of its 36 references that are in the map. First posted on arXiv 14 Oct 2021.
Builds on
12 of 36 references.
References · 12
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
- 2018InversionNet: A Real-Time and Accurate Full Waveform Inversion with CNNs and continuous CRFscited by 61
- 2019Deep-learning inversion: a next generation seismic velocity-model building methodcited by 50
- 2018Stochastic seismic waveform inversion using generative adversarial networks as a geological priorcited by 48
- 2019Deep-Learning Inversion of Seismic Datacited by 32
- 2018Data-driven Seismic Waveform Inversion: A Study on the Robustness and Generalizationcited by 30
- 2020Physics-Consistent Data-driven Waveform Inversion with Adaptive Data Augmentationcited by 8
- 2016Full waveform inversion guided by travel time tomographycited by 3
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 7; 2024: 7; 2025: 3; 2026: 5.
29 papers.
Sort:
By area:
- 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
- 2021OpenFWI: Large-Scale Multi-Structural Benchmark Datasets for Seismic Full Waveform Inversioncited by 44
- 2022Reliable amortized variational inference with physics-based latent distribution correctioncited by 25
- 2022Solving Seismic Wave Equations on Variable Velocity Models with Fourier Neural Operatorcited by 18
- 2024Knowledge-guided Machine Learning: Current Trends and Future Prospectscited by 14
- 2023WISE: full-Waveform variational Inference via Subsurface Extensionscited by 10
- 2023An Empirical Study of Large-Scale Data-Driven Full Waveform Inversioncited by 9
- 2022An Intriguing Property of Geophysics Inversioncited by 8
- 2023Auto-Linear Phenomenon in Subsurface Imagingcited by 6
- 2024A Unified Framework for Forward and Inverse Problems in Subsurface Imaging using Latent Space Translationscited by 5
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontierscited by 4
- 2022Inversion of Time-Lapse Surface Gravity Data for Detection of 3D CO2 Plumes via Deep Learningcited by 3
17 more
- 2022Extremely Weak Supervision Inversion of Multi-physical Propertiescited by 2
- 2023Edge-InversionNet: Enabling Efficient Inference of InversionNet on Edge Devicescited by 2
- 2024Integrating Physics of the Problem into Data-Driven Methods to Enhance Elastic Full-Waveform Inversion with Uncertainty Quantificationcited by 1
- 2024SG-DeepONet: Source-generalized deep operator learning for full waveform inversioncited by 1
- 2025Leveraging Deep Operator Networks (DeepONet) for Acoustic Full Waveform Inversion (FWI)cited by 1
- 2026Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Frameworkcited by 1
- 2021On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversioncited by 0
- 2023Overview of Physics-Informed Machine Learning Inversion of Geophysical Datacited by 0
- 2023SVInvNet: A Densely Connected Encoder-Decoder Architecture for Seismic Velocity Inversioncited by 0
- 2024Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networkscited by 0
- 2024Survey of Deep Learning and Physics-Based Approaches in Computational Wave Imagingcited by 0
- 2024On a Hidden Property in Computational Imagingcited by 0
- 2025SA-EMO: Structure-Aligned Encoder Mixture of Operators for Generalizable Full-waveform Inversioncited by 0
- 2026Improving Full Waveform Inversion in Large Model Eracited by 0
- 2026SPAMoE: Spectrum-Aware Hybrid Operator Framework for Full-Waveform Inversioncited by 0
- 2026Deciphering Neural Reparameterized Full-Waveform Inversion with Neural Sensitivity Kernel and Wave Tangent Kernelcited by 0
- 2026IQ-JEPA: A Joint-Embedding Predictive Architecture with a Hermitian Vision Transformer for Sound Speed and Attenuation Estimation from Ultrasound IQ Datacited by 0
- 2026IQ-JEPA: A Joint-Embedding Predictive Architecture with a Hermitian Vision Transformer for Sound Speed and Attenuation Estimation from Ultrasound IQ Data24 Jul 2026
- 2026Deciphering Neural Reparameterized Full-Waveform Inversion with Neural Sensitivity Kernel and Wave Tangent Kernel14 May 2026
- 2026SPAMoE: Spectrum-Aware Hybrid Operator Framework for Full-Waveform Inversion8 Apr 2026
- 2026Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Framework23 Mar 2026
- 2026Improving Full Waveform Inversion in Large Model Era27 Feb 2026
- 2025SA-EMO: Structure-Aligned Encoder Mixture of Operators for Generalizable Full-waveform Inversion7 Nov 2025
- 2025Leveraging Deep Operator Networks (DeepONet) for Acoustic Full Waveform Inversion (FWI)14 Apr 2025
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontiers5 Apr 2025
- 2024A Unified Framework for Forward and Inverse Problems in Subsurface Imaging using Latent Space Translations15 Oct 2024
- 2024On a Hidden Property in Computational Imaging11 Oct 2024
- 2024Survey of Deep Learning and Physics-Based Approaches in Computational Wave Imaging10 Oct 2024
- 2024SG-DeepONet: Source-generalized deep operator learning for full waveform inversion15 Aug 2024
17 more
- 2024Integrating Physics of the Problem into Data-Driven Methods to Enhance Elastic Full-Waveform Inversion with Uncertainty Quantification4 Jun 2024
- 2024Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networks27 May 2024
- 2024Knowledge-guided Machine Learning: Current Trends and Future Prospects24 Mar 2024
- 2023SVInvNet: A Densely Connected Encoder-Decoder Architecture for Seismic Velocity Inversion13 Dec 2023
- 2023WISE: full-Waveform variational Inference via Subsurface Extensions11 Dec 2023
- 2023Edge-InversionNet: Enabling Efficient Inference of InversionNet on Edge Devices14 Oct 2023
- 2023Overview of Physics-Informed Machine Learning Inversion of Geophysical Data12 Oct 2023
- 2023An Empirical Study of Large-Scale Data-Driven Full Waveform Inversion28 Jul 2023
- 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustness26 May 2023
- 2023Auto-Linear Phenomenon in Subsurface Imaging27 Apr 2023
- 2022Solving Seismic Wave Equations on Variable Velocity Models with Fourier Neural Operator25 Sep 2022
- 2022Inversion of Time-Lapse Surface Gravity Data for Detection of 3D CO2 Plumes via Deep Learning6 Sep 2022
- 2022Reliable amortized variational inference with physics-based latent distribution correction24 Jul 2022
- 2022An Intriguing Property of Geophysics Inversion28 Apr 2022
- 2022Extremely Weak Supervision Inversion of Multi-physical Properties3 Feb 2022
- 2021On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversion28 Nov 2021
- 2021OpenFWI: Large-Scale Multi-Structural Benchmark Datasets for Seismic Full Waveform Inversion4 Nov 2021
- 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
- 2021OpenFWI: Large-Scale Multi-Structural Benchmark Datasets for Seismic Full Waveform Inversioncited by 44
- 2022Reliable amortized variational inference with physics-based latent distribution correctioncited by 25
- 2022Solving Seismic Wave Equations on Variable Velocity Models with Fourier Neural Operatorcited by 18
- 2024Knowledge-guided Machine Learning: Current Trends and Future Prospectscited by 14
- 2023WISE: full-Waveform variational Inference via Subsurface Extensionscited by 10
- 2023An Empirical Study of Large-Scale Data-Driven Full Waveform Inversioncited by 9
- 2022An Intriguing Property of Geophysics Inversioncited by 8
- 2023Auto-Linear Phenomenon in Subsurface Imagingcited by 6
- 2024A Unified Framework for Forward and Inverse Problems in Subsurface Imaging using Latent Space Translationscited by 5
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontierscited by 4
- 2022Inversion of Time-Lapse Surface Gravity Data for Detection of 3D CO2 Plumes via Deep Learningcited by 3
12 most cited of 28 All 28 (JSON)
- 2026IQ-JEPA: A Joint-Embedding Predictive Architecture with a Hermitian Vision Transformer for Sound Speed and Attenuation Estimation from Ultrasound IQ Data24 Jul 2026
- 2026Deciphering Neural Reparameterized Full-Waveform Inversion with Neural Sensitivity Kernel and Wave Tangent Kernel14 May 2026
- 2026Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Framework23 Mar 2026
- 2026Improving Full Waveform Inversion in Large Model Era27 Feb 2026
- 2025SA-EMO: Structure-Aligned Encoder Mixture of Operators for Generalizable Full-waveform Inversion7 Nov 2025
- 2025Leveraging Deep Operator Networks (DeepONet) for Acoustic Full Waveform Inversion (FWI)14 Apr 2025
- 2025Foundation Models for Environmental Science: A Survey of Emerging Frontiers5 Apr 2025
- 2024A Unified Framework for Forward and Inverse Problems in Subsurface Imaging using Latent Space Translations15 Oct 2024
- 2024On a Hidden Property in Computational Imaging11 Oct 2024
- 2024Survey of Deep Learning and Physics-Based Approaches in Computational Wave Imaging10 Oct 2024
- 2024SG-DeepONet: Source-generalized deep operator learning for full waveform inversion15 Aug 2024
- 2024Integrating Physics of the Problem into Data-Driven Methods to Enhance Elastic Full-Waveform Inversion with Uncertainty Quantification4 Jun 2024
12 newest of 28 All 28 (JSON)