Caformer: Rethinking Time Series Analysis from Causal Perspective
Not on the map. Why?
Abstract (arXiv)
Time series analysis is a vital task with broad applications in various domains. However, effectively capturing cross-dimension and cross-time dependencies in non-stationary time series poses significant challenges, particularly in the context of environmental factors. The spurious correlation induced by the environment confounds the causal relationships between cross-dimension and cross-time dependencies. In this paper, we introduce a novel framework called Caformer (underlineCausal Transunderlineformer) for time series analysis from a causal perspective. Specifically, our framework comprises three components: Dynamic Learner, Environment Learner, and Dependency Learner. The Dynamic Learner unveils dynamic interactions among dimensions, the Environment Learner mitigates spurious correlations caused by environment with a back-door adjustment, and the Dependency Learner aims to infer robust interactions across both time and dimensions. Our Caformer demonstrates consistent state-of-the-art performance across five mainstream time series analysis tasks, including long- and short-term forecasting, imputation, classification, and anomaly detection, with proper interpretability.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 13 Mar 2024.
Builds on
25 of 40 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
- 2022Transformers in Time Series: A Surveycited by 497
- 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 410
- 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 394
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
13 more
- 2018The UEA multivariate time series classification archive, 2018cited by 338
- 2020Causal Intervention for Weakly-Supervised Semantic Segmentationcited by 229
- 2019Recurrent Independent Mechanismscited by 219
- 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 160
- 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 148
- 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 139
- 2020Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Datacited by 100
- 2021Gated Transformer Networks for Multivariate Time Series Classificationcited by 58
- 2022CEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model Behaviorcited by 55
- 2021Relating Graph Neural Networks to Structural Causal Modelscited by 41
- 2018Reservoir computing approaches for representation and classification of multivariate time seriescited by 38
- 2021TraverseNet: Unifying Space and Time in Message Passing for Traffic Forecastingcited by 16
- 2023From Continual Learning to Causal Discovery in Roboticscited by 6
Built on by
Citing papers per year: 2025: 1.
1 paper.