mlsanityData to 14 Oct 2026

Fi2VTS: Time Series Forecasting Via Capturing Intra- and Inter-Variable Variations in the Frequency Domain

arXiv 2407.21275 ↗First posted 31 Jul 2024cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Time series forecasting (TSF) plays a crucial role in various applications, including medical monitoring and crop growth. Despite the advancements in deep learning methods for TSF, their capacity to predict long-term series remains constrained. This limitation arises from the failure to account for both intra- and inter-variable variations meanwhile. To mitigate this challenge, we introduce the Fi2VBlock, which leverages a Frequency domain perspective to capture intra- and inter-variable Variations. After transforming into the frequency domain via the Frequency Transform Module, the Frequency Cross Attention between the real and imaginary parts is designed to obtain enhanced frequency representations and capture intra-variable variations. Furthermore, Inception blocks are employed to integrate information, thus capturing correlations across different variables. Our backbone network, Fi2VTS, employs a residual architecture by concatenating multiple Fi2VBlocks, thereby preventing degradation issues. Theoretically, we demonstrate that Fi2VTS achieves a substantial reduction in both time and memory complexity, decreasing from O(L2) to O(L) per Fi2VBlock computation. Empirical evaluations reveal that Fi2VTS outperforms other baselines on two benchmark datasets. The implementation code is accessible at urlhttps://github.com/HITshenrj/Fi2VTS.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 44 references that are in the map. First posted on arXiv 31 Jul 2024.

Builds on

12 of 44 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  5. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  6. 2020Reformer: The Efficient Transformercited by 1,668
  7. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  8. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  9. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
  10. 2021Global Filter Networks for Image Classificationcited by 260
  11. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 160
  12. 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 148

Built on by

Not cited yet.