Non-Stationary Time Series Forecasting Based on Fourier Analysis and Cross Attention Mechanism
Not on the map. Why?
Abstract (arXiv)
Time series forecasting has important applications in financial analysis, weather forecasting, and traffic management. However, existing deep learning models are limited in processing non-stationary time series data because they cannot effectively capture the statistical characteristics that change over time. To address this problem, this paper proposes a new framework, AEFIN, which enhances the information sharing ability between stable and unstable components by introducing a cross-attention mechanism, and combines Fourier analysis networks with MLP to deeply explore the seasonal patterns and trend characteristics in unstable components. In addition, we design a new loss function that combines time-domain stability constraints, time-domain instability constraints, and frequency-domain stability constraints to improve the accuracy and robustness of forecasting. Experimental results show that AEFIN outperforms the most common models in terms of mean square error and mean absolute error, especially under non-stationary data conditions, and shows excellent forecasting capabilities. This paper provides an innovative solution for the modeling and forecasting of non-stationary time series data, and contributes to the research of deep learning for complex time series.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 11 May 2025.
Builds on
23 of 31 references.
References · 23
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2021Transformers in Vision: A Surveycited by 1,013
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
- 2022Transformers in Time Series: A Surveycited by 497
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
- 2021FNet: Mixing Tokens with Fourier Transformscited by 347
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 338
11 more
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
- 2019A Comparative Study on Transformer vs RNN in Speech Applicationscited by 211
- 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 148
- 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
- 2021AdaRNN: Adaptive Learning and Forecasting of Time Seriescited by 121
- 2023Dish-TS: A General Paradigm for Alleviating Distribution Shift in Time Series Forecastingcited by 93
- 2021Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translationcited by 74
- 2020From Fourier to Koopman: Spectral Methods for Long-term Time Series Predictioncited by 50
- 2024Frequency Adaptive Normalization For Non-stationary Time Series Forecastingcited by 47
- 2022DDG-DA: Data Distribution Generation for Predictable Concept Drift Adaptationcited by 36
- 2020T-WaveNet: Tree-Structured Wavelet Neural Network for Sensor-Based Time Series Analysiscited by 1
Built on by
Citing papers per year: 2025: 2.
2 papers.