mlsanityData to 7 Oct 2026

MMFNet: Multi-Scale Frequency Masking Neural Network for Multivariate Time Series Forecasting

arXiv 2410.02070 ↗First posted 2 Oct 2024cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Long-term Time Series Forecasting (LTSF) is critical for numerous real-world applications, such as electricity consumption planning, financial forecasting, and disease propagation analysis. LTSF requires capturing long-range dependencies between inputs and outputs, which poses significant challenges due to complex temporal dynamics and high computational demands. While linear models reduce model complexity by employing frequency domain decomposition, current approaches often assume stationarity and filter out high-frequency components that may contain crucial short-term fluctuations. In this paper, we introduce MMFNet, a novel model designed to enhance long-term multivariate forecasting by leveraging a multi-scale masked frequency decomposition approach. MMFNet captures fine, intermediate, and coarse-grained temporal patterns by converting time series into frequency segments at varying scales while employing a learnable mask to filter out irrelevant components adaptively. Extensive experimentation with benchmark datasets shows that MMFNet not only addresses the limitations of the existing methods but also consistently achieves good performance. Specifically, MMFNet achieves up to 6.0% reductions in the Mean Squared Error (MSE) compared to state-of-the-art models designed for multivariate forecasting tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 43 references that are in the map. First posted on arXiv 2 Oct 2024.

Builds on

24 of 43 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  6. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  7. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  8. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  9. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  10. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  11. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  12. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
12 more
  1. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  2. 2021Multiscale Vision Transformerscited by 896
  3. 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
  4. 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 526
  5. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
  6. 2021FNet: Mixing Tokens with Fourier Transformscited by 343
  7. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
  8. 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 270
  9. 2023FITS: Modeling Time Series with 10k Parameterscited by 185
  10. 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
  11. 2024SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameterscited by 103
  12. 2024Parametric Augmentation for Time Series Contrastive Learningcited by 12

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.