mlsanityData to 14 Oct 2026

UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration

arXiv 2604.16325 ↗First posted 6 Mar 2026cs.LG cs.AIcited by 0

On the map: State-space sequence models (S4, Mamba) → Time series forecasting with SSMs

Abstract (arXiv)

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing Transformer-based methods capture temporal correlations through attention mechanisms but suffer from quadratic computational cost, while state-space models like Mamba achieve efficient long-context modeling yet lack explicit temporal pattern recognition. Therefore we introduce UniMamba, a unified spatial-temporal forecasting framework that integrates efficient state-space dynamics with attention-based dependency learning. UniMamba employs a Mamba Variate-Channel Encoding Layer enhanced with FFT-Laplace Transform and TCN to capture global temporal dependencies, and a Spatial Temporal Attention Layer to jointly model inter-variate correlations and temporal evolution. A Feedforward Temporal Dynamics Layer further fuses continuous and discrete contexts for accurate forecasting. Comprehensive experiments on eight public benchmark datasets demonstrate that UniMamba consistently outperforms state-of-the-art forecasting models in both forecasting accuracy and computational efficiency, establishing a scalable and robust solution for long-sequence multivariate time-series prediction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Time series forecasting with SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 18 of its 29 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

18 of 29 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026MODE: Efficient Time Series Prediction with Mamba Enhanced by Low-Rank Neural ODEs1 Jan
  2. 2025FLDmamba: Integrating Fourier and Laplace Transform Decomposition with Mamba for Enhanced Time Series Prediction17 Jul
  3. 2024Is Mamba Effective for Time Series Forecasting?17 Mar

Other references · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  4. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  5. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  6. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  7. 2020Time Series Forecasting With Deep Learning: A Surveycited by 459
  8. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 332
  9. 2015LSTM: A Search Space Odysseycited by 316
  10. 2017Gate-Variants of Gated Recurrent Unit (GRU) Neural Networkscited by 242
  11. 2024The Illusion of State in State-Space Modelscited by 187
  12. 2024SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time seriescited by 82
3 more
  1. 2024A Survey of Generative Techniques for Spatial-Temporal Data Miningcited by 14
  2. 2025Efficient Traffic Prediction Through Spatio-Temporal Distillationcited by 12
  3. 2025AutoHFormer: Efficient Hierarchical Autoregressive Transformer for Time Series Predictioncited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024CMamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecasting
  2. 2024MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting
  3. 2026DMamba: Decomposition-enhanced Mamba for Time Series Forecasting
  4. 2025S2TX: Cross-Attention Multi-Scale State-Space Transformer for Time Series Forecasting
  5. 2025DC-Mamber: A Dual Channel Prediction Model based on Mamba and Linear Transformer for Multivariate Time Series Forecasting
  6. 2024TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting
  7. 2024FMamba: Mamba based on Fast-attention for Multivariate Time-series Forecasting
  8. 2024Integration of Mamba and Transformer -- MAT for Long-Short Range Time Series Forecasting with Application to Weather Dynamics