Beyond All-to-All: Causal-Aligned Transformer with Dynamic Structure Learning for Multivariate Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Most existing multivariate time series forecasting methods adopt an all-to-all paradigm that feeds all variable histories into a unified model to predict their future values without distinguishing their individual roles. However, this undifferentiated paradigm makes it difficult to identify variable-specific causal influences and often entangles causally relevant information with spurious correlations. To address this limitation, we propose an all-to-one forecasting paradigm that predicts each target variable separately. Specifically, we first construct a Structural Causal Model from observational data and then, for each target variable, we partition the historical sequence into four subsegments according to the inferred causal structure: endogenous, direct causal, collider causal, and spurious correlation. Furthermore, we propose the Causal Decomposition Transformer (CDT), which integrates a dynamic causal adapter to learn causal structures initialized by the inferred graph, enabling correction of imperfect causal discovery during training. Furthermore, motivated by causal theory, we apply a projection-based output constraint to mitigate collider induced bias and improve robustness. Extensive experiments on multiple benchmark datasets demonstrate the effectiveness of the CDT.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 45 of its 125 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
45 of 125 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2020Time Series Forecasting With Deep Learning: A Surveycited by 459
33 more
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
- 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 250
- 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 248
- 2017Detecting causal associations in large nonlinear time series datasetscited by 244
- 2020Representation Learning via Invariant Causal Mechanismscited by 199
- 2020Learning in the Frequency Domaincited by 198
- 2023FITS: Modeling Time Series with 10k Parameterscited by 195
- 2020FcaNet: Frequency Channel Attention Networkscited by 179
- 2019Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directionscited by 172
- 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 172
- 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
- 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
- 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 144
- 2023UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecastingcited by 144
- 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 113
- 2024Pathformer: Multi-scale Transformers with Adaptive Pathways for Time Series Forecastingcited by 104
- 2022Filter-enhanced MLP is All You Need for Sequential Recommendationcited by 96
- 2024Timer-XL: Long-Context Transformers for Unified Time Series Forecastingcited by 87
- 2022Multivariate Time Series Forecasting with Dynamic Graph Neural ODEscited by 72
- 2020From Fourier to Koopman: Spectral Methods for Long-term Time Series Predictioncited by 50
- 2022Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecastingcited by 42
- 2024Learning Pattern-Specific Experts for Time Series Forecasting Under Patch-level Distribution Shiftcited by 24
- 2021Causal Hidden Markov Model for Time Series Disease Forecastingcited by 19
- 2022Multi-scale Attention Flow for Probabilistic Time Series Forecastingcited by 19
- 2024CausalFormer: An Interpretable Transformer for Temporal Causal Discoverycited by 17
- 2021Time series compression: a surveycited by 16
- 2023Spatio-Temporal Branching for Motion Prediction using Motion Incrementscited by 9
- 2023Causal Discovery from Subsampled Time Series with Proxy Variablescited by 8
- 2024Not All Frequencies Are Created Equal:Towards a Dynamic Fusion of Frequencies in Time-Series Forecastingcited by 6
- 2023Infomaxformer: Maximum Entropy Transformer for Long Time-Series Forecasting Problemcited by 5
- 2023GCformer: An Efficient Framework for Accurate and Scalable Long-Term Multivariate Time Series Forecastingcited by 5
- 2023Enhancing Representation Learning for Periodic Time Series with Floss: A Frequency Domain Regularization Approachcited by 5
- 2020Extracting Seasonal Gradual Patterns from Temporal Sequence Data Using Periodic Patterns Miningcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.