mlsanityData to 7 Oct 2026

On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversion

arXiv 2111.14220 ↗First posted 28 Nov 2021cs.LG eess.SPcited by 0

Not on the map. Why?

Abstract (arXiv)

The data-driven approach has been demonstrated as a promising technique to solve complicated scientific problems. Full Waveform Inversion (FWI) is commonly epitomized as an image-to-image translation task, which motivates the use of deep neural networks as an end-to-end solution. Despite being trained with synthetic data, the deep learning-driven FWI is expected to perform well when evaluated with sufficient real-world data. In this paper, we study such properties by asking: how robust are these deep neural networks and how do they generalize? For robustness, we prove the upper bounds of the deviation between the predictions from clean and noisy data. Moreover, we demonstrate an interplay between the noise level and the additional gain of loss. For generalization, we prove a norm-based generalization error upper bound via a stability-generalization framework. Experimental results on seismic FWI datasets corroborate with the theoretical results, shedding light on a better understanding of utilizing Deep Learning for complicated scientific applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 73 references that are in the map. First posted on arXiv 28 Nov 2021.

Builds on

42 of 73 references.

References · 42

  1. 2013Intriguing properties of neural networkscited by 5,114
  2. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  3. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  4. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  5. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  6. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  7. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
  8. 2017Spectrally-normalized margin bounds for neural networkscited by 681
  9. 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
  10. 2017Exploring Generalization in Deep Learningcited by 595
  11. 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
  12. 2019Fantastic Generalization Measures and Where to Find Themcited by 507
30 more
  1. 2015A Neural Algorithm of Artistic Stylecited by 480
  2. 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 413
  3. 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
  4. 2017A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networkscited by 309
  5. 2018Stronger generalization bounds for deep nets via a compression approachcited by 306
  6. 2015Norm-Based Capacity Control in Neural Networkscited by 299
  7. 2019Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networkscited by 290
  8. 2017Size-Independent Sample Complexity of Neural Networkscited by 289
  9. 2019Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networkscited by 221
  10. 2016A guide to convolution arithmetic for deep learningcited by 182
  11. 2017Spectral Norm Regularization for Improving the Generalizability of Deep Learningcited by 178
  12. 2018A high-bias, low-variance introduction to Machine Learning for physicistscited by 108
  13. 2018The Singular Values of Convolutional Layerscited by 95
  14. 2018InversionNet: A Real-Time and Accurate Full Waveform Inversion with CNNs and continuous CRFscited by 60
  15. 2019Generalization bounds for deep convolutional neural networkscited by 58
  16. 2019Lipschitz Certificates for Layered Network Structures Driven by Averaged Activation Operatorscited by 54
  17. 2019Deep-learning inversion: a next generation seismic velocity-model building methodcited by 48
  18. 2017Enhancing Robustness of Machine Learning Systems via Data Transformationscited by 38
  19. 2020On Mean Absolute Error for Deep Neural Network Based Vector-to-Vector Regressioncited by 33
  20. 2019Deep-Learning Inversion of Seismic Datacited by 30
  21. 2018On Lipschitz Bounds of General Convolutional Neural Networkscited by 29
  22. 2021Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loopcited by 29
  23. 2018On Tighter Generalization Bound for Deep Neural Networks: CNNs, ResNets, and Beyondcited by 24
  24. 2019Generalization Bounds for Convolutional Neural Networkscited by 21
  25. 2016Is the deconvolution layer the same as a convolutional layer?cited by 16
  26. 2021InversionNet3D: Efficient and Scalable Learning for 3D Full Waveform Inversioncited by 12
  27. 2017Lipschitz Properties for Deep Convolutional Networkscited by 9
  28. 2021Making Invisible Visible: Data-Driven Seismic Inversion with Spatio-temporally Constrained Data Augmentationcited by 4
  29. 2019SAG-VAE: End-to-end Joint Inference of Data Representations and Feature Relationscited by 2
  30. 2021Data-driven Full-waveform Inversion Surrogate using Conditional Generative Adversarial Networkscited by 2

Built on by

Not cited yet.