mlsanityData to 14 Oct 2026

LMS-AutoTSF: Learnable Multi-Scale Decomposition and Integrated Autocorrelation for Time Series Forecasting

arXiv 2412.06866 ↗First posted 9 Dec 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Time series forecasting is an important challenge with significant applications in areas such as weather prediction, stock market analysis, scientific simulations and industrial process analysis. In this work, we introduce LMS-AutoTSF, a novel time series forecasting architecture that incorporates autocorrelation while leveraging dual encoders operating at multiple scales. Unlike models that rely on predefined trend and seasonal components, LMS-AutoTSF employs two separate encoders per scale: one focusing on low-pass filtering to capture trends and the other utilizing high-pass filtering to model seasonal variations. These filters are learnable, allowing the model to dynamically adapt and isolate trend and seasonal components directly in the frequency domain. A key innovation in our approach is the integration of autocorrelation, achieved by computing lagged differences in time steps, which enables the model to capture dependencies across time more effectively. Each encoder processes the input through fully connected layers to handle temporal and channel interactions. By combining frequency-domain filtering, autocorrelation-based temporal modeling, and channel-wise transformations, LMS-AutoTSF not only accurately captures long-term dependencies and fine-grained patterns but also operates more efficiently compared to other state-of-the-art methods. Its lightweight design ensures faster processing while maintaining high precision in forecasting across diverse time horizons. The source code is publicly available at urlhttp://github.com/mribrahim/LMS-TSF

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 19 references that are in the map. First posted on arXiv 9 Dec 2024.

Builds on

12 of 19 references.

References · 12

  1. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  3. 2020Reformer: The Efficient Transformercited by 1,668
  4. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  5. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  6. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  7. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
  8. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  9. 2021AutoFormer: Searching Transformers for Visual Recognitioncited by 188
  10. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
  11. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 160
  12. 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 139

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.