PMDformer: Patch-Mean Decoupling Information Transformer for Long-term Forecasting
Not on the map. Why?
Abstract (arXiv)
Long-term time series forecasting (LTSF) plays a crucial role in fields such as energy management, finance, and traffic prediction. Transformer-based models have adopted patch-based strategies to capture long-range dependencies, but accurately modeling shape similarities across patches and variables remains challenging due to scale differences. To address this, we introduce patch-mean decoupling (PMD), which separates the trend and residual shape information by subtracting the mean of each patch, preserving the original structure and ensuring that the attention mechanism captures true shape similarities. Futhermore, to more effectively model long-range dependencies and capture cross-variable relationships, we propose Trend Restoration Attention (TRA) and Proximal Variable Attention (PVA). The former module reintegrates the decoupled trend from PMD while calculating attention output. And the latter focuses cross-variable attention on the most relevant, recent time segments to avoid overfitting on outdated correlations. Combining these components, we propose PMDformer, a model designed to effectively capture shape similarity in long-term forecasting scenarios. Extensive experiments indicate that PMDformer outperforms existing state-of-the-art methods in stability and accuracy across multiple LTSF benchmarks. The code is available at https://github.com/aohu1105/PMDformer.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 50 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
33 of 50 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2023A decoder-only foundation model for time-series forecastingcited by 692
21 more
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
- 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 248
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
- 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 139
- 2023FourierGNN: Rethinking Multivariate Time Series Forecasting from a Pure Graph Perspectivecited by 127
- 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 118
- 2024SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameterscited by 107
- 2024Pathformer: Multi-scale Transformers with Adaptive Pathways for Time Series Forecastingcited by 104
- 2023Dish-TS: A General Paradigm for Alleviating Distribution Shift in Time Series Forecastingcited by 93
- 2024SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusioncited by 76
- 2023OneNet: Enhancing Time Series Forecasting Models under Concept Drift by Online Ensemblingcited by 74
- 2024TSLANet: Rethinking Transformers for Time Series Representation Learningcited by 74
- 2025Battling the Non-stationarity in Time Series Forecasting via Test-time Adaptationcited by 35
- 2025Temporal Query Network for Efficient Multivariate Time Series Forecastingcited by 31
- 2025FinTSB: A Comprehensive and Practical Benchmark for Financial Time Series Forecastingcited by 24
- 2023PatchMixer: A Patch-Mixing Architecture for Long-Term Time Series Forecastingcited by 20
- 2024TimeCNN: Refining Cross-Variable Interaction on Time Point for Time Series Forecastingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.