UmambaTSF: A U-shaped Multi-Scale Long-Term Time Series Forecasting Method Using Mamba
On the map: State-space sequence models (S4, Mamba) → Time series forecasting with SSMs
Abstract (arXiv)
Multivariate Time series forecasting is crucial in domains such as transportation, meteorology, and finance, especially for predicting extreme weather events. State-of-the-art methods predominantly rely on Transformer architectures, which utilize attention mechanisms to capture temporal dependencies. However, these methods are hindered by quadratic time complexity, limiting the model's scalability with respect to input sequence length. This significantly restricts their practicality in the real world. Mamba, based on state space models (SSM), provides a solution with linear time complexity, increasing the potential for efficient forecasting of sequential data. In this study, we propose UmambaTSF, a novel long-term time series forecasting framework that integrates multi-scale feature extraction capabilities of U-shaped encoder-decoder multilayer perceptrons (MLP) with Mamba's long sequence representation. To improve performance and efficiency, the Mamba blocks introduced in the framework adopt a refined residual structure and adaptable design, enabling the capture of unique temporal signals and flexible channel processing. In the experiments, UmambaTSF achieves state-of-the-art performance and excellent generality on widely used benchmark datasets while maintaining linear time complexity and low memory consumption.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Time series forecasting with SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 31 of its 47 references that are in the map. First posted on arXiv 15 Oct 2024.
Builds on
31 of 47 references.
Closest ancestors · 2
Same direction, newest first
- 2024Is Mamba Effective for Time Series Forecasting?17 Mar
- 2024TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting14 Mar
Other references · 29
- 2017Attention Is All You Needcited by 59,932
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
17 more
- 2022Simplified State Space Layers for Sequence Modelingcited by 776
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
- 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
- 2024Swin-UMamba: Mamba-based UNet with ImageNet-based pretrainingcited by 179
- 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 136
- 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inferencecited by 97
- 2024VL-Mamba: Exploring State Space Models for Multimodal Learningcited by 93
- 2024The Hidden Attention of Mamba Modelscited by 88
- 2024Graph Mamba: Towards Learning on Graphs with State Space Modelscited by 84
- 2024SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time seriescited by 81
- 2022Flowformer: Linearizing Transformers with Conservation Flowscited by 69
- 2022Multi-scale Attention Flow for Probabilistic Time Series Forecastingcited by 19
- 2024U-Mixer: An Unet-Mixer Architecture with Stationarity Correction for Time Series Forecastingcited by 7
Built on by
Citing papers per year: 2025: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Integration of Mamba and Transformer -- MAT for Long-Short Range Time Series Forecasting with Application to Weather Dynamics
- 2024FMamba: Mamba based on Fast-attention for Multivariate Time-series Forecasting
- 2024SST: Multi-Scale Hybrid Mamba-Transformer Experts for Time Series Forecasting
- 2026DMamba: Decomposition-enhanced Mamba for Time Series Forecasting
- 2025DC-Mamber: A Dual Channel Prediction Model based on Mamba and Linear Transformer for Multivariate Time Series Forecasting
- 2024Bi-Mamba+: Bidirectional Mamba for Time Series Forecasting
- 2026UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration
- 2025ms-Mamba: Multi-scale Mamba for Time-Series Forecasting