Distributed Lag Transformer based on Time-Variable-Aware Learning for Explainable Multivariate Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Time series data is a key element of big data analytics, commonly found in domains such as finance, healthcare, climate forecasting, and transportation. In large scale real world settings, such data is often high dimensional and multivariate, requiring advanced forecasting methods that are both accurate and interpretable. Although Transformer based models perform well in multivariate time series forecasting (MTSF), their lack of explainability limits their use in critical applications. To overcome this, we propose Distributed Lag Transformer (DLFormer), a novel Transformer architecture for explainable and scalable MTSF. DLFormer integrates a distributed lag embedding and a time variable aware learning (TVAL) mechanism to structurally model both local and global temporal dependencies and explicitly capture the influence of past variables on future outcomes. Experiments on ten benchmark and real world datasets show that DLFormer achieves state of the art predictive accuracy while offering robust, interpretable insights into variable wise and temporal dynamics. These results highlight ability of DLFormer to bridge the gap between performance and explainability, making it highly suitable for practical big data forecasting tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 69 references that are in the map. First posted on arXiv 29 Aug 2024.
Builds on
24 of 69 references.
References · 24
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2019Attention is not Explanationcited by 929
12 more
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 476
- 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
- 2021Darts: User-Friendly Modern Machine Learning for Time Seriescited by 91
- 2020TimeSHAP: Explaining Recurrent Models through Sequence Perturbationscited by 74
- 2021GLocalX -- From Local to Global Explanations of Black Box AI Modelscited by 48
- 2019Exploring Interpretable LSTM Neural Networks over Multi-Variable Datacited by 42
- 2020XCM: An Explainable Convolutional Neural Network for Multivariate Time Series Classificationcited by 24
- 2023Revisiting the Performance-Explainability Trade-Off in Explainable Artificial Intelligence (XAI)cited by 10
- 2023Counterfactual Explanations for Time Series Forecastingcited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025HDT: Hierarchical Discrete Transformer for Multivariate Time Series Forecasting
- 2025S2TX: Cross-Attention Multi-Scale State-Space Transformer for Time Series Forecasting
- 2026Superposition Is Not Necessary: A Mechanistic Interpretability Analysis of Transformer Representations for Time Series Forecasting
- 2024Sparse-VQ Transformer: An FFN-Free Framework with Vector Quantization for Enhanced Time Series Forecasting
- 2026WorldTS: World Modeling for Multimodal Covariate-aware Time Series Forecasting
- 2026DiTS: Multimodal Diffusion Transformers Are Time Series Forecasters
- 2026vLinear: A Powerful Linear Model for Multivariate Time Series Forecasting
- 2025Fusing Large Language Models with Temporal Transformers for Time Series Forecasting