mlsanityData to 7 Oct 2026

Revisiting Long-term Time Series Forecasting: An Investigation on Linear Mapping

arXiv 2305.10721 ↗First posted 18 May 2023cs.LG cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Introduction: Long-term time series forecasting (LTSF) has gained significant attention in recent years. While various specialized designs exist for capturing temporal dependency, recent studies have shown that even a single linear layer can achieve competitive performance. This paper investigates the intrinsic effectiveness of recent LTSF approaches and reveals the critical role of affine mapping. Materials and methods: We conduct comprehensive experiments on both simulated and real-world datasets to analyze the components of state-of-the-art models. A theoretical analysis is provided to explain the working mechanisms of affine mapping in periodic signal forecasting. We evaluate the impact of reversible normalization and input horizon extension on model robustness. Results: We find that (1) affine mapping dominates forecasting performance across commonly utilized benchmarks, with models learning similar transition matrices from input to output; (2) affine mapping effectively captures periodic patterns but struggles with non-periodic signals or time series with varying periods across channels; (3) reversible normalization significantly enhances trend forecasting by transforming non-periodic trends into periodic-like patterns; (4) increasing input horizon improves performance on multi-channel data with different periods. Code is available at: urlhttps://github.com/plumprc/RTSF. Conclusions: Our findings provide theoretical and experimental insights into the working mechanisms of LTSF models, highlighting both the strengths and limitations of linear approaches. The results suggest that future model development should focus on handling cross-channel period variations and non-periodic components.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 21 of its 39 references that are in the map. First posted on arXiv 18 May 2023.

Builds on

21 of 39 references.

References · 21

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  5. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  6. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  7. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  8. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  9. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  10. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  11. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
  12. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
9 more
  1. 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
  2. 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 146
  3. 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 143
  4. 2023Dish-TS: A General Paradigm for Alleviating Distribution Shift in Time Series Forecastingcited by 91
  5. 2022Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecastingcited by 54
  6. 2023MTS-Mixers: Multivariate Time Series Forecasting via Factorized Temporal and Channel Mixingcited by 52
  7. 2022First De-Trend then Attend: Rethinking Attention for Time-Series Forecastingcited by 19
  8. 2023Deep ReLU Networks Have Surprisingly Simple Polytopescited by 5
  9. 2023Unwrapping All ReLU Networkscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 1; 2026: 3.

11 papers.