mlsanityData to 7 Oct 2026

MSMixer: Learned Multi-Scale Temporal Mixing with Complementary Linear Shortcut for Long-Term Time Series Forecasting

arXiv 2605.02689 ↗First posted 4 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Long-term time series forecasting requires models that simultaneously capture rapid oscillations, medium-range periodicities, and slowly evolving macro-trends from a fixed look-back window. Existing lightweight MLP-based models typically operate on a single temporal resolution, limiting their ability to explicitly model patterns at multiple scales. We propose MSMixer, a channel-independent multi-scale MLP architecture that addresses this limitation through three complementary innovations: (i) three parallel scale branches at down-sample factors {1x, 4x, 16x} with independent MLP blocks, (ii) a learnable softmax gate that dynamically weighs branch outputs, and (iii) a DLinear complementary shortcut that provides full-window trend and seasonality context. MSMixer contains only 112K parameters at H=96 and runs at O(T) complexity. Evaluated on four ETT benchmarks with standard chronological splits and three random seeds, MSMixer achieves the lowest average MSE (0.357) among lightweight models, outperforming DLinear (0.386, -7.4%) and NLinear (0.365, -2.1%), winning 12 of 16 configurations. Against five Transformer-based baselines from the literature, MSMixer achieves best or second-best MSE in 9 of 16 configurations while using 5x fewer parameters than PatchTST. Ablation and sensitivity analyses confirm the complementary contributions of the multi-scale branches and the DLinear shortcut.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

23 of 31 references.

References · 23

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  7. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  8. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  9. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  10. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  11. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  12. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
11 more
  1. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  2. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  3. 2023A decoder-only foundation model for time-series forecastingcited by 650
  4. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  5. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  6. 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
  7. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
  8. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
  9. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
  10. 2022N-HiTS: Neural Hierarchical Interpolation for Time Series Forecastingcited by 146
  11. 2023Dish-TS: A General Paradigm for Alleviating Distribution Shift in Time Series Forecastingcited by 91

Built on by

Not cited yet.