mlsanityData to 14 Oct 2026

ITS-Mina: A Harris Hawks Optimization-Based All-MLP Framework with Iterative Refinement and External Attention for Multivariate Time Series Forecasting

arXiv 2604.27981 ↗First posted 30 Apr 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Multivariate time series forecasting plays a pivotal role in numerous real-world applications, including financial analysis, energy management, and traffic planning. While Transformer-based architectures have gained popularity for this task, recent studies reveal that simpler MLP-based models can achieve competitive or superior performance with significantly reduced computational cost. In this paper, we propose ITS-Mina, a novel all-MLP framework for multivariate time series forecasting that integrates three key innovations: (1) an iterative refinement mechanism that progressively enhances temporal representations by repeatedly applying a shared-parameter residual mixer stack, effectively deepening the model's computational capacity without multiplying the number of distinct parameters; (2) an external attention module that replaces traditional self-attention with learnable memory units, capturing cross-sample global dependencies at linear computational complexity; and (3) a Harris Hawks Optimization (HHO) algorithm for automatic dropout rate tuning, enabling adaptive regularization tailored to each dataset. Extensive experiments on six widely-used benchmark datasets demonstrate that ITS-Mina achieves state-of-the-art or highly competitive performance compared to eleven baseline models across multiple forecasting horizons.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

19 of 24 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  4. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  5. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  6. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  7. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  8. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  9. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  10. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  11. 2018Universal Transformerscited by 647
  12. 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
7 more
  1. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240
  2. 2019Depth-Adaptive Transformercited by 236
  3. 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
  4. 2023LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation -- Extended Versioncited by 50
  5. 2022MLP4Rec: A Pure MLP Architecture for Sequential Recommendationscited by 22
  6. 2023PatchMixer: A Patch-Mixing Architecture for Long-Term Time Series Forecastingcited by 20
  7. 2024Loop Neural Networks for Parameter Sharingcited by 11

Built on by

Not cited yet.