mlsanityData to 7 Oct 2026

Time Series Model Attribution Visualizations as Explanations

arXiv 2109.12935 ↗First posted 27 Sep 2021cs.LG cs.HCcited by 8

Not on the map. Why?

Abstract (arXiv)

Attributions are a common local explanation technique for deep learning models on single samples as they are easily extractable and demonstrate the relevance of input values. In many cases, heatmaps visualize such attributions for samples, for instance, on images. However, heatmaps are not always the ideal visualization to explain certain model decisions for other data types. In this review, we focus on attribution visualizations for time series. We collect attribution heatmap visualizations and some alternatives, discuss the advantages as well as disadvantages and give a short position towards future opportunities for attributions and explanations for time series.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 26 of its 42 references that are in the map. First posted on arXiv 27 Sep 2021.

Builds on

26 of 42 references.

References · 26

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  4. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  5. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  6. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  7. 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
  8. 2017SmoothGrad: removing noise by adding noisecited by 1,097
  9. 2014Striving for Simplicity: The All Convolutional Netcited by 983
  10. 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
  11. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  12. 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 467
14 more
  1. 2017Methods for Interpreting and Understanding Deep Neural Networkscited by 342
  2. 2017The (Un)reliability of saliency methodscited by 331
  3. 2017The Shattered Gradients Problem: If resnets are the answer, then what is the question?cited by 156
  4. 2018Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontierscited by 117
  5. 2019explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learningcited by 69
  6. 2019Towards a Rigorous Evaluation of XAI Methods on Time Seriescited by 67
  7. 2019Evaluating Recurrent Neural Network Explanationscited by 29
  8. 2021TS-MULE: Local Interpretable Model-Agnostic Explanations for Time Series Forecast Modelscited by 28
  9. 2018TSViz: Demystification of Deep Learning Models for Time-Series Analysiscited by 25
  10. 2019Deep neural networks can predict mortality from 12-lead electrocardiogram voltage datacited by 20
  11. 2018A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systemscited by 16
  12. 2020timeXplain -- A Framework for Explaining the Predictions of Time Series Classifierscited by 9
  13. 2020TSInsight: A local-global attribution framework for interpretability in time-series datacited by 8
  14. 2020An Empirical Study of Explainable AI Techniques on Deep Learning Models For Time Series Taskscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 2; 2025: 2; 2026: 1.

8 papers.

  1. 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
  2. 2023A Deep Dive into Perturbations as Evaluation Technique for Time Series XAIcited by 11
  3. 2023Visual Explanations with Attributions and Counterfactuals on Time Series Classificationcited by 5
  4. 2025Revisiting Backdoor Attacks on Time Series Classification in the Frequency Domaincited by 4
  5. 2023Introducing the Attribution Stability Indicator: a Measure for Time Series XAI Attributionscited by 2
  6. 2024Interactive dense pixel visualizations for time series and model attribution explanationscited by 1
  7. 2025FREQuency ATTribution: benchmarking frequency-based occlusion for time series datacited by 0
  8. 2026L2GTX: From Local to Global Time Series Explanationscited by 0