TimePro: Efficient Multivariate Long-term Time Series Forecasting with Variable- and Time-Aware Hyper-state
Not on the map. Why?
Abstract (arXiv)
In long-term time series forecasting, different variables often influence the target variable over distinct time intervals, a challenge known as the multi-delay issue. Traditional models typically process all variables or time points uniformly, which limits their ability to capture complex variable relationships and obtain non-trivial time representations. To address this issue, we propose TimePro, an innovative Mamba-based model that constructs variate- and time-aware hyper-states. Unlike conventional approaches that merely transfer plain states across variable or time dimensions, TimePro preserves the fine-grained temporal features of each variate token and adaptively selects the focused time points to tune the plain state. The reconstructed hyper-state can perceive both variable relationships and salient temporal information, which helps the model make accurate forecasting. In experiments, TimePro performs competitively on eight real-world long-term forecasting benchmarks with satisfactory linear complexity. Code is available at https://github.com/xwmaxwma/TimePro.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
23 of 32 references.
References · 23
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
- 2022Diagonal State Spaces are as Effective as Structured State Spacescited by 350
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 338
11 more
- 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 160
- 2024Is Mamba Effective for Time Series Forecasting?cited by 114
- 2024SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusioncited by 76
- 2024TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecastingcited by 64
- 2024Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applicationscited by 50
- 2019Recurrent Neural Networks for Time Series Forecastingcited by 19
- 2024Bi-Mamba+: Bidirectional Mamba for Time Series Forecastingcited by 15
- 2024Channel-Aware Low-Rank Adaptation in Time Series Forecastingcited by 12
- 2024A Mamba Foundation Model for Time Series Forecastingcited by 9
- 2024Linearly-evolved Transformer for Pan-sharpeningcited by 5
- 2023Contextualizing MLP-Mixers Spatiotemporally for Urban Data Forecast at Scalecited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 13.
16 papers.
Sort:
By area:
- 2025AlphaCast: A Human Wisdom-LLM Intelligence Co-Reasoning Framework for Interactive Time Series Forecastingcited by 12
- 2026Enhancing Multivariate Time Series Forecasting with Global Temporal Retrievalcited by 5
- 2025TimeExpert: Boosting Long Time Series Forecasting with Temporal Mix of Expertscited by 4
- 2026vLinear: A Powerful Linear Model for Multivariate Time Series Forecastingcited by 1
- 2026DMamba: Decomposition-enhanced Mamba for Time Series Forecastingcited by 1
- 2026DualWeaver: Synergistic Feature Weaving Surrogates for Multivariate Forecasting with Univariate Time Series Foundation Modelscited by 1
- 2026What If We Let Forecasting Forget? A Sparse Bottleneck for Cross-Variable Dependenciescited by 1
- 2025Ada-MoGE: Adaptive Mixture of Gaussian Expert Model for Time Series Forecastingcited by 0
- 2026ACFormer: Mitigating Non-linearity with Auto Convolutional Encoder for Time Series Forecastingcited by 0
- 2026Permutation-Equivariant 2D State Space Models: Theory and Canonical Architecture for Multivariate Time Seriescited by 0
- 2026MICA: Multivariate Infini Compressive Attention for Time Series Forecastingcited by 0
- 2026Generalizing Multi-Scale Time-Series Modeling with a Single Operatorcited by 0
4 more
- 2026VLBM: Variational Latent Basis Modeling for OOD Robust Multivariate Time Series Forecastingcited by 0
- 2026TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modelingcited by 0
- 2026CARNet Cycle-Conditioned Core Aggregation and Redistribution for Multivariate Time Series Forecastingcited by 0
- 2026UniGIO: Unified Generative Global In-situ Weather Modeling from Spatiotemporal Incomplete Observationscited by 0
- 2026UniGIO: Unified Generative Global In-situ Weather Modeling from Spatiotemporal Incomplete Observations2 Sep 2026
- 2026CARNet Cycle-Conditioned Core Aggregation and Redistribution for Multivariate Time Series Forecasting23 Jul 2026
- 2026TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modeling14 Jul 2026
- 2026VLBM: Variational Latent Basis Modeling for OOD Robust Multivariate Time Series Forecasting1 Jun 2026
- 2026Generalizing Multi-Scale Time-Series Modeling with a Single Operator29 May 2026
- 2026What If We Let Forecasting Forget? A Sparse Bottleneck for Cross-Variable Dependencies8 May 2026
- 2026MICA: Multivariate Infini Compressive Attention for Time Series Forecasting7 Apr 2026
- 2026Permutation-Equivariant 2D State Space Models: Theory and Canonical Architecture for Multivariate Time Series7 Mar 2026
- 2026DualWeaver: Synergistic Feature Weaving Surrogates for Multivariate Forecasting with Univariate Time Series Foundation Models25 Feb 2026
- 2026Enhancing Multivariate Time Series Forecasting with Global Temporal Retrieval11 Feb 2026
- 2026DMamba: Decomposition-enhanced Mamba for Time Series Forecasting9 Feb 2026
- 2026ACFormer: Mitigating Non-linearity with Auto Convolutional Encoder for Time Series Forecasting28 Jan 2026
4 more
- 2026vLinear: A Powerful Linear Model for Multivariate Time Series Forecasting20 Jan 2026
- 2025Ada-MoGE: Adaptive Mixture of Gaussian Expert Model for Time Series Forecasting29 Nov 2025
- 2025AlphaCast: A Human Wisdom-LLM Intelligence Co-Reasoning Framework for Interactive Time Series Forecasting12 Nov 2025
- 2025TimeExpert: Boosting Long Time Series Forecasting with Temporal Mix of Experts27 Sep 2025
- 2026Enhancing Multivariate Time Series Forecasting with Global Temporal Retrievalcited by 5
- 2025TimeExpert: Boosting Long Time Series Forecasting with Temporal Mix of Expertscited by 4
- 2026vLinear: A Powerful Linear Model for Multivariate Time Series Forecastingcited by 1
- 2026DualWeaver: Synergistic Feature Weaving Surrogates for Multivariate Forecasting with Univariate Time Series Foundation Modelscited by 1
- 2026What If We Let Forecasting Forget? A Sparse Bottleneck for Cross-Variable Dependenciescited by 1
- 2026ACFormer: Mitigating Non-linearity with Auto Convolutional Encoder for Time Series Forecastingcited by 0
- 2026Permutation-Equivariant 2D State Space Models: Theory and Canonical Architecture for Multivariate Time Seriescited by 0
- 2026MICA: Multivariate Infini Compressive Attention for Time Series Forecastingcited by 0
- 2026Generalizing Multi-Scale Time-Series Modeling with a Single Operatorcited by 0
- 2026VLBM: Variational Latent Basis Modeling for OOD Robust Multivariate Time Series Forecastingcited by 0
- 2026TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modelingcited by 0
- 2026CARNet Cycle-Conditioned Core Aggregation and Redistribution for Multivariate Time Series Forecastingcited by 0
12 most cited of 13 All 13 (JSON)
- 2026UniGIO: Unified Generative Global In-situ Weather Modeling from Spatiotemporal Incomplete Observations2 Sep 2026
- 2026CARNet Cycle-Conditioned Core Aggregation and Redistribution for Multivariate Time Series Forecasting23 Jul 2026
- 2026TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modeling14 Jul 2026
- 2026VLBM: Variational Latent Basis Modeling for OOD Robust Multivariate Time Series Forecasting1 Jun 2026
- 2026Generalizing Multi-Scale Time-Series Modeling with a Single Operator29 May 2026
- 2026What If We Let Forecasting Forget? A Sparse Bottleneck for Cross-Variable Dependencies8 May 2026
- 2026MICA: Multivariate Infini Compressive Attention for Time Series Forecasting7 Apr 2026
- 2026Permutation-Equivariant 2D State Space Models: Theory and Canonical Architecture for Multivariate Time Series7 Mar 2026
- 2026DualWeaver: Synergistic Feature Weaving Surrogates for Multivariate Forecasting with Univariate Time Series Foundation Models25 Feb 2026
- 2026Enhancing Multivariate Time Series Forecasting with Global Temporal Retrieval11 Feb 2026
- 2026ACFormer: Mitigating Non-linearity with Auto Convolutional Encoder for Time Series Forecasting28 Jan 2026
- 2026vLinear: A Powerful Linear Model for Multivariate Time Series Forecasting20 Jan 2026
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting
- 2026UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration
- 2024CMamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecasting
- 2025ParallelTime: Dynamically Weighting the Balance of Short- and Long-Term Temporal Dependencies
- 2024Integration of Mamba and Transformer -- MAT for Long-Short Range Time Series Forecasting with Application to Weather Dynamics
- 2025DC-Mamber: A Dual Channel Prediction Model based on Mamba and Linear Transformer for Multivariate Time Series Forecasting
- 2025S2TX: Cross-Attention Multi-Scale State-Space Transformer for Time Series Forecasting
- 2026AdaMamba: Adaptive Frequency-Gated Mamba for Long-Term Time Series Forecasting