HPMixer: Hierarchical Patching for Multivariate Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
In long-term multivariate time series forecasting, effectively capturing both periodic patterns and residual dynamics is essential. To address this within standard deep learning benchmark settings, we propose the Hierarchical Patching Mixer (HPMixer), which models periodicity and residuals in a decoupled yet complementary manner. The periodic component utilizes a learnable cycle module [7] enhanced with a nonlinear channel-wise MLP for greater expressiveness. The residual component is processed through a Learnable Stationary Wavelet Transform (LSWT) to extract stable, shift-invariant frequency-domain representations. Subsequently, a channel-mixing encoder models explicit inter-channel dependencies, while a two-level non-overlapping hierarchical patching mechanism captures coarse- and fine-scale residual variations. By integrating decoupled periodicity modeling with structured, multi-scale residual learning, HPMixer provides an effective framework. Extensive experiments on standard multivariate benchmarks demonstrate that HPMixer achieves competitive or state-of-the-art performance compared to recent baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 21 references that are in the map. First posted on arXiv 18 Feb 2026.
Builds on
18 of 21 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
- 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 241
- 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
6 more
- 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 170
- 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 136
- 2024CycleNet: Enhancing Time Series Forecasting through Modeling Periodic Patternscited by 102
- 2023MSGNet: Learning Multi-Scale Inter-Series Correlations for Multivariate Time Series Forecastingcited by 50
- 2021Fully Learnable Deep Wavelet Transform for Unsupervised Monitoring of High-Frequency Time Seriescited by 29
- 2024WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecastingcited by 25
Built on by
Not cited yet.