C-SHAP for time series: An approach to high-level temporal explanations
Not on the map. Why?
Abstract (arXiv)
In high-stakes domains, such as healthcare and industry, the explainability of AI-based decision-making has become crucial. Without insight into model reasoning, the reliability of these models cannot be ensured. Applications often rely on the time series data type which, unlike the image data type, is underexplored with respect to the development of explainable AI (XAI) techniques. Most existing XAI techniques for time series are focused on point- or subsequence-based explanations. This limits their usability since points and subsequences do not capture all relevant patterns and may not result in human-interpretable explainability. In this paper, we close this gap and propose a concept-based XAI approach (C-SHAP), where concepts are defined as high-level patterns extracted from the time series data. C-SHAP leverages the SHAP method to determine the influence of these concepts on predictions. The effectiveness of the developed framework is illustrated for use cases from healthcare and industry, in the form of Human Activity Recognition (HAR) and predictive maintenance.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 55 references that are in the map. First posted on arXiv 15 Apr 2025.
Builds on
23 of 55 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2020Concept Bottleneck Modelscited by 1,032
- 2016Time Series Classification from Scratch with Deep Neural Networks: A Strong Baselinecited by 360
- 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 254
- 2019On Completeness-aware Concept-Based Explanations in Deep Neural Networkscited by 239
- 2017LSTM Fully Convolutional Networks for Time Series Classificationcited by 136
- 2019Explaining Classifiers with Causal Concept Effect (CaCE)cited by 135
11 more
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 98
- 2021A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Conceptscited by 91
- 2020TimeSHAP: Explaining Recurrent Models through Sequence Perturbationscited by 74
- 2021Time Series Prediction using Deep Learning Methods in Healthcarecited by 74
- 2019Towards a Rigorous Evaluation of XAI Methods on Time Seriescited by 67
- 2022Concept Activation Regions: A Generalized Framework For Concept-Based Explanationscited by 57
- 2023Explain Any Concept: Segment Anything Meets Concept-Based Explanationcited by 37
- 2018EA-LSTM: Evolutionary Attention-based LSTM for Time Series Predictioncited by 26
- 2022WindowSHAP: An Efficient Framework for Explaining Time-series Classifiers based on Shapley Valuescited by 24
- 2020Concept-based model explanations for Electronic Health Recordscited by 14
- 2024FLEXtime: Filterbank learning to explain time seriescited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026GroupSegment-SHAP: Shapley Value Explanations with Group-Segment Players for Multivariate Time Seriescited by 1
- 2026Explainable AI to Improve Machine Learning Reliability for Industrial Cyber-Physical Systemscited by 0
- 2026ConceptCF: Concept-based Counterfactuals for the Explainability of Time Seriescited by 0
- 2026ConceptCF: Concept-based Counterfactuals for the Explainability of Time Series21 Jul 2026
- 2026Explainable AI to Improve Machine Learning Reliability for Industrial Cyber-Physical Systems22 Jan 2026
- 2026GroupSegment-SHAP: Shapley Value Explanations with Group-Segment Players for Multivariate Time Series3 Jan 2026