Interpretability in Deep Time Series Models Demands Semantic Alignment
Not on the map. Why?
Abstract (arXiv)
Deep time series models continue to improve predictive performance, yet their deployment remains limited by their black-box nature. In response, existing interpretability approaches in the field keep focusing on explaining the internal model computations, without addressing whether they align or not with how a human would reason about the studied phenomenon. Instead, we state interpretability in deep time series models should pursue semantic alignment: predictions should be expressed in terms of variables that are meaningful to the end user, mediated by spatial and temporal mechanisms that admit user-dependent constraints. In this paper, we formalize this requirement and state that, once established, semantic alignment must be preserved under temporal evolution: a constraint with no analog in static settings. Provided with this definition, we outline a blueprint for semantically aligned deep time series models, identify properties that support trust, and discuss implications for model design.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 84 of its 129 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
84 of 129 references.
References · 84
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2016Concrete Problems in AI Safetycited by 1,582
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2018Sanity Checks for Saliency Mapscited by 1,149
38 more
- 2019Attention is not Explanationcited by 916
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2019Attention is not not Explanationcited by 629
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
- 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
- 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
- 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 343
- 2022Post-hoc Concept Bottleneck Modelscited by 289
- 2023Label-Free Concept Bottleneck Modelscited by 282
- 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 228
- 2018Online Learning: A Comprehensive Surveycited by 203
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 191
- 2022Large Language Models with Controllable Working Memorycited by 169
- 2020Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AIcited by 166
- 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
- 2021Promises and Pitfalls of Black-Box Concept Learning Modelscited by 128
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
- 2020Deep Learning for Time Series Forecasting: Tutorial and Literature Surveycited by 117
- 2021Graph-Guided Network for Irregularly Sampled Multivariate Time Seriescited by 110
- 2020Benchmarking Deep Learning Interpretability in Time Series Predictionscited by 102
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 97
- 2020Inductive Graph Neural Networks for Spatiotemporal Krigingcited by 90
- 2022Impossibility Theorems for Feature Attributioncited by 78
- 2020TimeSHAP: Explaining Recurrent Models through Sequence Perturbationscited by 73
- 2024Theoretical Foundations of Deep Selective State-Space Modelscited by 73
- 2021Explaining Time Series Predictions with Dynamic Maskscited by 72
- 2021From Statistical Relational to Neurosymbolic Artificial Intelligence: a Surveycited by 72
- 2021Explainable Artificial Intelligence (XAI) on TimeSeries Data: A Surveycited by 71
- 2024Kolmogorov-Arnold Networks for Time Series: Bridging Predictive Power and Interpretabilitycited by 69
- 2024A Survey on Kolmogorov-Arnold Networkcited by 67
- 2020Instance-based Counterfactual Explanations for Time Series Classificationcited by 64
- 2017Deep Lattice Networks and Partial Monotonic Functionscited by 62
- 2022Evaluation of post-hoc interpretability methods in time-series classificationcited by 53
- 2024Stochastic Concept Bottleneck Modelscited by 49
- 2022Rethinking Attention-Model Explainability through Faithfulness Violation Testcited by 43
- 2024Incremental Residual Concept Bottleneck Modelscited by 43
50 most cited of 84 All 84 (JSON)
Built on by
Not cited yet.