mlsanityData to 14 Oct 2026

Multivariate Long-term Time Series Forecasting with Fourier Neural Filter

arXiv 2506.09174 ↗First posted 10 Jun 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multivariate long-term time series forecasting has been suffering from the challenge of capturing both temporal dependencies within variables and spatial correlations across variables simultaneously. Current approaches predominantly repurpose backbones from natural language processing or computer vision (e.g., Transformers), which fail to adequately address the unique properties of time series (e.g., periodicity). The research community lacks a dedicated backbone with temporal-specific inductive biases, instead relying on domain-agnostic backbones supplemented with auxiliary techniques (e.g., signal decomposition). We introduce FNF as the backbone and DBD as the architecture to provide excellent learning capabilities and optimal learning pathways for spatio-temporal modeling, respectively. Our theoretical analysis proves that FNF unifies local time-domain and global frequency-domain information processing within a single backbone that extends naturally to spatial modeling, while information bottleneck theory demonstrates that DBD provides superior gradient flow and representation capacity compared to existing unified or sequential architectures. Our empirical evaluation across 11 public benchmark datasets spanning five domains (energy, meteorology, transportation, environment, and nature) confirms state-of-the-art performance with consistent hyperparameter settings. Notably, our approach achieves these results without any auxiliary techniques, suggesting that properly designed neural architectures can capture the inherent properties of time series, potentially transforming time series modeling in scientific and industrial applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 10 Jun 2025.

Builds on

29 of 46 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  5. 2017Non-local Neural Networkscited by 2,293
  6. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  7. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  8. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  9. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  10. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  11. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  12. 2016Deep Variational Information Bottleneckcited by 930
17 more
  1. 2015Deep Learning and the Information Bottleneck Principlecited by 802
  2. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  3. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  4. 2023A decoder-only foundation model for time-series forecastingcited by 692
  5. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  6. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
  7. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
  8. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
  9. 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 116
  10. 2024Pathformer: Multi-scale Transformers with Adaptive Pathways for Time Series Forecastingcited by 104
  11. 2023Dish-TS: A General Paradigm for Alleviating Distribution Shift in Time Series Forecastingcited by 93
  12. 2024FreDF: Learning to Forecast in the Frequency Domaincited by 79
  13. 2024Frequency Adaptive Normalization For Non-stationary Time Series Forecastingcited by 47
  14. 2023Multi-resolution Time-Series Transformer for Long-term Forecastingcited by 41
  15. 2024From Similarity to Superiority: Channel Clustering for Time Series Forecastingcited by 37
  16. 2023Learning to Embed Time Series Patches Independentlycited by 35
  17. 2024PRformer: Pyramidal Recurrent Transformer for Multivariate Time Series Forecastingcited by 5

Built on by

Not cited yet.