Characterizing climate pathways using feature importance on echo state networks
Not on the map. Why?
Abstract (arXiv)
The 2022 National Defense Strategy of the United States listed climate change as a serious threat to national security. Climate intervention methods, such as stratospheric aerosol injection, have been proposed as mitigation strategies, but the downstream effects of such actions on a complex climate system are not well understood. The development of algorithmic techniques for quantifying relationships between source and impact variables related to a climate event (i.e., a climate pathway) would help inform policy decisions. Data-driven deep learning models have become powerful tools for modeling highly nonlinear relationships and may provide a route to characterize climate variable relationships. In this paper, we explore the use of an echo state network (ESN) for characterizing climate pathways. ESNs are a computationally efficient neural network variation designed for temporal data, and recent work proposes ESNs as a useful tool for forecasting spatio-temporal climate data. Like other neural networks, ESNs are non-interpretable black-box models, which poses a hurdle for understanding variable relationships. We address this issue by developing feature importance methods for ESNs in the context of spatio-temporal data to quantify variable relationships captured by the model. We conduct a simulation study to assess and compare the feature importance techniques, and we demonstrate the approach on reanalysis climate data. In the climate application, we select a time period that includes the 1991 volcanic eruption of Mount Pinatubo. This event was a significant stratospheric aerosol injection, which we use as a proxy for an artificial stratospheric aerosol injection. Using the proposed approach, we are able to characterize relationships between pathway variables associated with this event.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 20 of its 57 references that are in the map. First posted on arXiv 12 Oct 2023.
Builds on
20 of 57 references.
References · 20
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2016The Mythos of Model Interpretabilitycited by 721
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 614
- 2018All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneouslycited by 373
- 2018On the Robustness of Interpretability Methodscited by 314
- 2019Interpretable machine learning: definitions, methods, and applicationscited by 305
- 2020Problems with Shapley-value-based explanations as feature importance measurescited by 200
- 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 159
- 2020Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challengescited by 120
- 2019Unrestricted Permutation forces Extrapolation: Variable Importance Requires at least One More Model, or There Is No Free Variable Importancecited by 87
8 more
- 2020General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning Modelscited by 75
- 2022Investigating the fidelity of explainable artificial intelligence methods for applications of convolutional neural networks in geosciencecited by 28
- 2018Deep Echo State Networks with Uncertainty Quantification for Spatio-Temporal Forecastingcited by 16
- 2017An Ensemble Quadratic Echo State Network for Nonlinear Spatio-Temporal Forecastingcited by 12
- 2022Explainable Artificial Intelligence for Bayesian Neural Networks: Towards trustworthy predictions of ocean dynamicscited by 11
- 2021Feature Importance Explanations for Temporal Black-Box Modelscited by 7
- 2021On the Post-hoc Explainability of Deep Echo State Networks for Time Series Forecasting, Image and Video Classificationcited by 3
- 2022Layer-wise Relevance Propagation for Echo State Networks applied to Earth System Variabilitycited by 2
Built on by
Citing papers per year: 2024: 2.
2 papers.