mlsanityData to 7 Oct 2026

HPMixer: Hierarchical Patching for Multivariate Time Series Forecasting

arXiv 2602.16468 ↗First posted 18 Feb 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In long-term multivariate time series forecasting, effectively capturing both periodic patterns and residual dynamics is essential. To address this within standard deep learning benchmark settings, we propose the Hierarchical Patching Mixer (HPMixer), which models periodicity and residuals in a decoupled yet complementary manner. The periodic component utilizes a learnable cycle module [7] enhanced with a nonlinear channel-wise MLP for greater expressiveness. The residual component is processed through a Learnable Stationary Wavelet Transform (LSWT) to extract stable, shift-invariant frequency-domain representations. Subsequently, a channel-mixing encoder models explicit inter-channel dependencies, while a two-level non-overlapping hierarchical patching mechanism captures coarse- and fine-scale residual variations. By integrating decoupled periodicity modeling with structured, multi-scale residual learning, HPMixer provides an effective framework. Extensive experiments on standard multivariate benchmarks demonstrate that HPMixer achieves competitive or state-of-the-art performance compared to recent baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 21 references that are in the map. First posted on arXiv 18 Feb 2026.

Builds on

18 of 21 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  8. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  9. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  10. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
  11. 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 241
  12. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
6 more
  1. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 170
  2. 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 136
  3. 2024CycleNet: Enhancing Time Series Forecasting through Modeling Periodic Patternscited by 102
  4. 2023MSGNet: Learning Multi-Scale Inter-Series Correlations for Multivariate Time Series Forecastingcited by 50
  5. 2021Fully Learnable Deep Wavelet Transform for Unsupervised Monitoring of High-Frequency Time Seriescited by 29
  6. 2024WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecastingcited by 25

Built on by

Not cited yet.