mlsanityData to 14 Oct 2026

Three-Stage Learning Unlocks Strong Performance in Simple Models for Long-Term Time Series Forecasting

arXiv 2605.13678 ↗First posted 13 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent studies on long-term time series forecasting have shown that simple linear models and MLP-based predictors can achieve strong performance without increasingly complex architectures. However, many competitive baselines still rely on structural priors such as frequency-domain modeling, explicit decomposition, multi-scale mixing, or sophisticated cross-variable interaction modules, while paying less attention to how simple temporal mappings should be trained and organized. In this paper, we propose STAIR, short for Stagewise Temporal Adaptation via Individualization and Residual Learning, a training paradigm for long-term time series forecasting that aims to unlock the capacity of simple temporal mapping models without introducing complex architectural modules. STAIR decomposes forecasting ability into three progressive stages: it first learns common temporal dynamics across variables through a shared temporal mapping, then adapts the shared model to each variable via channel-wise fine-tuning to capture variable-specific patterns, and finally complements the backbone with cross-variable information through residual learning. We further introduce Shared-to-Individual Fine-tuning and alpha-RevIN to mitigate the limitations of strict channel independence and the overly strong normalization prior induced by standard RevIN. This design gradually increases modeling flexibility while keeping the core temporal predictor as a shallow MLP in the main experiments, with linear variants analyzed separately. Experiments on nine long-term forecasting benchmarks show that STAIR matches or outperforms recent strong baselines while preserving a simple temporal backbone, providing a concise and effective modeling perspective for long-term time series forecasting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 2 of its 17 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

2 of 17 references.

References · 2

  1. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 332
  2. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240

Built on by

Not cited yet.