mlsanityData to 14 Oct 2026

Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop

arXiv 2110.07584 ↗First posted 14 Oct 2021cs.LG eess.SP physics.geo-phcited by 29

Not on the map. Why?

Abstract (arXiv)

This paper investigates unsupervised learning of Full-Waveform Inversion (FWI), which has been widely used in geophysics to estimate subsurface velocity maps from seismic data. This problem is mathematically formulated by a second order partial differential equation (PDE), but is hard to solve. Moreover, acquiring velocity map is extremely expensive, making it impractical to scale up a supervised approach to train the mapping from seismic data to velocity maps with convolutional neural networks (CNN). We address these difficulties by integrating PDE and CNN in a loop, thus shifting the paradigm to unsupervised learning that only requires seismic data. In particular, we use finite difference to approximate the forward modeling of PDE as a differentiable operator (from velocity map to seismic data) and model its inversion by CNN (from seismic data to velocity map). Hence, we transform the supervised inversion task into an unsupervised seismic data reconstruction task. We also introduce a new large-scale dataset OpenFWI, to establish a more challenging benchmark for the community. Experiment results show that our model (using seismic data alone) yields comparable accuracy to the supervised counterpart (using both seismic data and velocity map). Furthermore, it outperforms the supervised model when involving more seismic data.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 12 of its 36 references that are in the map. First posted on arXiv 14 Oct 2021.

Builds on

12 of 36 references.

References · 12

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  4. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  5. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  6. 2018InversionNet: A Real-Time and Accurate Full Waveform Inversion with CNNs and continuous CRFscited by 61
  7. 2019Deep-learning inversion: a next generation seismic velocity-model building methodcited by 50
  8. 2018Stochastic seismic waveform inversion using generative adversarial networks as a geological priorcited by 48
  9. 2019Deep-Learning Inversion of Seismic Datacited by 32
  10. 2018Data-driven Seismic Waveform Inversion: A Study on the Robustness and Generalizationcited by 30
  11. 2020Physics-Consistent Data-driven Waveform Inversion with Adaptive Data Augmentationcited by 8
  12. 2016Full waveform inversion guided by travel time tomographycited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 2; 2022: 5; 2023: 7; 2024: 7; 2025: 3; 2026: 5.

29 papers.

Sort:

By area:

  1. 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
  2. 2021OpenFWI: Large-Scale Multi-Structural Benchmark Datasets for Seismic Full Waveform Inversioncited by 44
  3. 2022Reliable amortized variational inference with physics-based latent distribution correctioncited by 25
  4. 2022Solving Seismic Wave Equations on Variable Velocity Models with Fourier Neural Operatorcited by 18
  5. 2024Knowledge-guided Machine Learning: Current Trends and Future Prospectscited by 14
  6. 2023WISE: full-Waveform variational Inference via Subsurface Extensionscited by 10
  7. 2023An Empirical Study of Large-Scale Data-Driven Full Waveform Inversioncited by 9
  8. 2022An Intriguing Property of Geophysics Inversioncited by 8
  9. 2023Auto-Linear Phenomenon in Subsurface Imagingcited by 6
  10. 2024A Unified Framework for Forward and Inverse Problems in Subsurface Imaging using Latent Space Translationscited by 5
  11. 2025Foundation Models for Environmental Science: A Survey of Emerging Frontierscited by 4
  12. 2022Inversion of Time-Lapse Surface Gravity Data for Detection of 3D CO2 Plumes via Deep Learningcited by 3
17 more
  1. 2022Extremely Weak Supervision Inversion of Multi-physical Propertiescited by 2
  2. 2023Edge-InversionNet: Enabling Efficient Inference of InversionNet on Edge Devicescited by 2
  3. 2024Integrating Physics of the Problem into Data-Driven Methods to Enhance Elastic Full-Waveform Inversion with Uncertainty Quantificationcited by 1
  4. 2024SG-DeepONet: Source-generalized deep operator learning for full waveform inversioncited by 1
  5. 2025Leveraging Deep Operator Networks (DeepONet) for Acoustic Full Waveform Inversion (FWI)cited by 1
  6. 2026Unveiling the Mechanism of Continuous Representation Full-Waveform Inversion: A Wave Based Neural Tangent Kernel Frameworkcited by 1
  7. 2021On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversioncited by 0
  8. 2023Overview of Physics-Informed Machine Learning Inversion of Geophysical Datacited by 0
  9. 2023SVInvNet: A Densely Connected Encoder-Decoder Architecture for Seismic Velocity Inversioncited by 0
  10. 2024Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networkscited by 0
  11. 2024Survey of Deep Learning and Physics-Based Approaches in Computational Wave Imagingcited by 0
  12. 2024On a Hidden Property in Computational Imagingcited by 0
  13. 2025SA-EMO: Structure-Aligned Encoder Mixture of Operators for Generalizable Full-waveform Inversioncited by 0
  14. 2026Improving Full Waveform Inversion in Large Model Eracited by 0
  15. 2026SPAMoE: Spectrum-Aware Hybrid Operator Framework for Full-Waveform Inversioncited by 0
  16. 2026Deciphering Neural Reparameterized Full-Waveform Inversion with Neural Sensitivity Kernel and Wave Tangent Kernelcited by 0
  17. 2026IQ-JEPA: A Joint-Embedding Predictive Architecture with a Hermitian Vision Transformer for Sound Speed and Attenuation Estimation from Ultrasound IQ Datacited by 0