On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversion
Not on the map. Why?
Abstract (arXiv)
The data-driven approach has been demonstrated as a promising technique to solve complicated scientific problems. Full Waveform Inversion (FWI) is commonly epitomized as an image-to-image translation task, which motivates the use of deep neural networks as an end-to-end solution. Despite being trained with synthetic data, the deep learning-driven FWI is expected to perform well when evaluated with sufficient real-world data. In this paper, we study such properties by asking: how robust are these deep neural networks and how do they generalize? For robustness, we prove the upper bounds of the deviation between the predictions from clean and noisy data. Moreover, we demonstrate an interplay between the noise level and the additional gain of loss. For generalization, we prove a norm-based generalization error upper bound via a stability-generalization framework. Experimental results on seismic FWI datasets corroborate with the theoretical results, shedding light on a better understanding of utilizing Deep Learning for complicated scientific applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 73 references that are in the map. First posted on arXiv 28 Nov 2021.
Builds on
42 of 73 references.
References · 42
- 2013Intriguing properties of neural networkscited by 5,114
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2017Spectrally-normalized margin bounds for neural networkscited by 681
- 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
- 2017Exploring Generalization in Deep Learningcited by 595
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
- 2019Fantastic Generalization Measures and Where to Find Themcited by 507
30 more
- 2015A Neural Algorithm of Artistic Stylecited by 480
- 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 413
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
- 2017A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networkscited by 309
- 2018Stronger generalization bounds for deep nets via a compression approachcited by 306
- 2015Norm-Based Capacity Control in Neural Networkscited by 299
- 2019Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networkscited by 290
- 2017Size-Independent Sample Complexity of Neural Networkscited by 289
- 2019Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networkscited by 221
- 2016A guide to convolution arithmetic for deep learningcited by 182
- 2017Spectral Norm Regularization for Improving the Generalizability of Deep Learningcited by 178
- 2018A high-bias, low-variance introduction to Machine Learning for physicistscited by 108
- 2018The Singular Values of Convolutional Layerscited by 95
- 2018InversionNet: A Real-Time and Accurate Full Waveform Inversion with CNNs and continuous CRFscited by 60
- 2019Generalization bounds for deep convolutional neural networkscited by 58
- 2019Lipschitz Certificates for Layered Network Structures Driven by Averaged Activation Operatorscited by 54
- 2019Deep-learning inversion: a next generation seismic velocity-model building methodcited by 48
- 2017Enhancing Robustness of Machine Learning Systems via Data Transformationscited by 38
- 2020On Mean Absolute Error for Deep Neural Network Based Vector-to-Vector Regressioncited by 33
- 2019Deep-Learning Inversion of Seismic Datacited by 30
- 2018On Lipschitz Bounds of General Convolutional Neural Networkscited by 29
- 2021Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loopcited by 29
- 2018On Tighter Generalization Bound for Deep Neural Networks: CNNs, ResNets, and Beyondcited by 24
- 2019Generalization Bounds for Convolutional Neural Networkscited by 21
- 2016Is the deconvolution layer the same as a convolutional layer?cited by 16
- 2021InversionNet3D: Efficient and Scalable Learning for 3D Full Waveform Inversioncited by 12
- 2017Lipschitz Properties for Deep Convolutional Networkscited by 9
- 2021Making Invisible Visible: Data-Driven Seismic Inversion with Spatio-temporally Constrained Data Augmentationcited by 4
- 2019SAG-VAE: End-to-end Joint Inference of Data Representations and Feature Relationscited by 2
- 2021Data-driven Full-waveform Inversion Surrogate using Conditional Generative Adversarial Networkscited by 2
Built on by
Not cited yet.