Using explainability to design physics-aware CNNs for solving subsurface inverse problems
Not on the map. Why?
Abstract (arXiv)
We present a novel method of using explainability techniques to design physics-aware neural networks. We demonstrate our approach by developing a convolutional neural network (CNN) for solving an inverse problem for shallow subsurface imaging. Although CNNs have gained popularity in recent years across many fields, the development of CNNs remains an art, as there are no clear guidelines regarding the selection of hyperparameters that will yield the best network. While optimization algorithms may be used to select hyperparameters automatically, these methods focus on developing networks with high predictive accuracy while disregarding model explainability (descriptive accuracy). However, the field of Explainable Artificial Intelligence (XAI) addresses the absence of model explainability by providing tools that allow developers to evaluate the internal logic of neural networks. In this study, we use the explainability methods Score-CAM and Deep SHAP to select hyperparameters, such as kernel sizes and network depth, to develop a physics-aware CNN for shallow subsurface imaging. We begin with a relatively deep Encoder-Decoder network, which uses surface wave dispersion images as inputs and generates 2D shear wave velocity subsurface images as outputs. Through model explanations, we ultimately find that a shallow CNN using two convolutional layers with an atypical kernel size of 3x1 yields comparable predictive accuracy but with increased descriptive accuracy. We also show that explainability methods can be used to evaluate the network's complexity and decision-making. We believe this method can be used to develop neural networks with high predictive accuracy while also providing inherent explainability.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 56 references that are in the map. First posted on arXiv 16 Nov 2022.
Builds on
24 of 56 references.
References · 24
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
- 2016TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systemscited by 664
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
- 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 461
- 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 379
12 more
- 2019Interpretable machine learning: definitions, methods, and applicationscited by 305
- 2019XRAI: Better Attributions Through Regionscited by 116
- 2020Solving Inverse Problems With Deep Neural Networks -- Robustness Included?cited by 58
- 2019Deep-learning inversion: a next generation seismic velocity-model building methodcited by 50
- 2016CMA-ES for Hyperparameter Optimization of Deep Neural Networkscited by 48
- 2019Explainable artificial intelligence model to predict acute critical illness from electronic health recordscited by 42
- 2019Deep-Learning Inversion of Seismic Datacited by 32
- 2018Speeding up the Hyperparameter Optimization of Deep Convolutional Neural Networkscited by 10
- 202070 years of machine learning in geoscience in reviewcited by 10
- 2019Progressive transfer learning for low frequency data prediction in full waveform inversioncited by 3
- 2022A Frequency-Velocity CNN for Developing Near-Surface 2D Vs Images from Linear-Array, Active-Source Wavefield Measurementscited by 2
- 2019Enhanced Seismic Imaging with Predictive Neural Networks for Geophysicscited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.