mlsanityData to 7 Oct 2026

Not All Frequencies Are Created Equal:Towards a Dynamic Fusion of Frequencies in Time-Series Forecasting

arXiv 2407.12415 ↗First posted 17 Jul 2024cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Long-term time series forecasting is a long-standing challenge in various applications. A central issue in time series forecasting is that methods should expressively capture long-term dependency. Furthermore, time series forecasting methods should be flexible when applied to different scenarios. Although Fourier analysis offers an alternative to effectively capture reusable and periodic patterns to achieve long-term forecasting in different scenarios, existing methods often assume high-frequency components represent noise and should be discarded in time series forecasting. However, we conduct a series of motivation experiments and discover that the role of certain frequencies varies depending on the scenarios. In some scenarios, removing high-frequency components from the original time series can improve the forecasting performance, while in others scenarios, removing them is harmful to forecasting performance. Therefore, it is necessary to treat the frequencies differently according to specific scenarios. To achieve this, we first reformulate the time series forecasting problem as learning a transfer function of each frequency in the Fourier domain. Further, we design Frequency Dynamic Fusion (FreDF), which individually predicts each Fourier component, and dynamically fuses the output of different frequencies. Moreover, we provide a novel insight into the generalization ability of time series forecasting and propose the generalization bound of time series forecasting. Then we prove FreDF has a lower bound, indicating that FreDF has better generalization ability. Extensive experiments conducted on multiple benchmark datasets and ablation studies demonstrate the effectiveness of FreDF. The code is available at https://github.com/Zh-XY22/FreDF.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 31 of its 73 references that are in the map. First posted on arXiv 17 Jul 2024.

Builds on

31 of 73 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  7. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  8. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  9. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  10. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  11. 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 360
  12. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
19 more
  1. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
  2. 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 246
  3. 2020Representation Learning via Invariant Causal Mechanismscited by 197
  4. 2020Learning in the Frequency Domaincited by 196
  5. 2023FITS: Modeling Time Series with 10k Parameterscited by 185
  6. 2020FcaNet: Frequency Channel Attention Networkscited by 177
  7. 2019Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directionscited by 172
  8. 2023FourierGNN: Rethinking Multivariate Time Series Forecasting from a Pure Graph Perspectivecited by 126
  9. 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 110
  10. 2022Filter-enhanced MLP is All You Need for Sequential Recommendationcited by 96
  11. 2020From Fourier to Koopman: Spectral Methods for Long-term Time Series Predictioncited by 50
  12. 2023A Survey on Deep Learning based Time Series Analysis with Frequency Transformationcited by 40
  13. 2023Spatio-Temporal Branching for Motion Prediction using Motion Incrementscited by 9
  14. 2023Infomaxformer: Maximum Entropy Transformer for Long Time-Series Forecasting Problemcited by 5
  15. 2023Does Long-Term Series Forecasting Need Complex Attention and Extra Long Inputs?cited by 5
  16. 2023GCformer: An Efficient Framework for Accurate and Scalable Long-Term Multivariate Time Series Forecastingcited by 5
  17. 2023Enhancing Representation Learning for Periodic Time Series with Floss: A Frequency Domain Regularization Approachcited by 5
  18. 2022Comparative Analysis of Time Series Forecasting Approaches for Household Electricity Consumption Predictioncited by 4
  19. 2020Extracting Seasonal Gradual Patterns from Temporal Sequence Data Using Periodic Patterns Miningcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.