Nonstationary Time Series Forecasting via Unknown Distribution Adaptation
Not on the map. Why?
Abstract (arXiv)
As environments evolve, temporal distribution shifts can degrade time series forecasting performance. A straightforward solution is to adapt to nonstationary changes while preserving stationary dependencies. Hence, some methods disentangle stationary and nonstationary components by assuming uniform distribution shifts, but it is impractical since when the distribution changes is unknown. To address this challenge, we propose the Unknown Distribution Adaptation (UDA) model for nonstationary time series forecasting, which detects when distribution shifts occur and disentangles stationary/nonstationary latent variables, thus enabling adaptation to unknown distribution without assuming a uniform distribution shift. Specifically, under a Hidden Markov assumption of latent environments, we demonstrate that the latent environments are identifiable. Sequentially, we further disentangle stationary/nonstationary latent variables by leveraging the variability of historical information. Based on these theoretical results, we propose a variational autoencoder-based model, which incorporates an autoregressive hidden Markov model to estimate latent environments. Additionally, we further devise the modular prior networks to disentangle stationary/nonstationary latent variables. These two modules realize automatic adaptation and enhance nonstationary forecasting performance. Experimental results on several datasets validate the effectiveness of our approach.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 45 of its 83 references that are in the map. First posted on arXiv 20 Feb 2024.
Builds on
45 of 83 references.
References · 45
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
- 2022Simplified State Space Layers for Sequence Modelingcited by 788
33 more
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 503
- 2020Time Series Forecasting With Deep Learning: A Surveycited by 459
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 424
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 282
- 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 273
- 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 273
- 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 241
- 2023FITS: Modeling Time Series with 10k Parameterscited by 195
- 2016Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive controlcited by 140
- 2022CITRIS: Causal Identifiability from Temporal Intervened Sequencescited by 133
- 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 113
- 2020ICE-BeeM: Identifiable Conditional Energy-Based Deep Models Based on Nonlinear ICAcited by 102
- 2021Learning Temporally Causal Latent Processes from General Temporal Datacited by 98
- 2020On Disentangled Representations Learned From Correlated Datacited by 94
- 2020Hidden Markov Nonlinear ICA: Unsupervised Learning from Nonstationary Time Seriescited by 77
- 2020Meta-learning framework with applications to zero-shot time-series forecastingcited by 70
- 2020S3VAE: Self-Supervised Sequential VAE for Representation Disentanglement and Data Generationcited by 63
- 2022Temporally Disentangled Representation Learningcited by 61
- 2023Identifiability of latent-variable and structural-equation models: from linear to nonlinearcited by 58
- 2019Disentangling Factors of Variation Using Few Labelscited by 57
- 2014Variational Recurrent Auto-Encoderscited by 53
- 2020Time Series Domain Adaptation via Sparse Associative Structure Alignmentcited by 51
- 2017Inference via low-dimensional couplingscited by 44
- 2023Understanding Masked Autoencoders via Hierarchical Latent Variable Modelscited by 39
- 2019Variational Temporal Abstractioncited by 38
- 2023Subspace Identification for Multi-Source Domain Adaptationcited by 37
- 2023Identification of Nonlinear Latent Hierarchical Modelscited by 27
- 2021Transferable Time-Series Forecasting under Causal Conditional Shiftcited by 18
- 2022Contrastive Domain Adaptation for Time-Series via Temporal Mixupcited by 18
- 2023Identifying Semantic Component for Robust Molecular Property Predictioncited by 10
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.