mlsanityData to 14 Oct 2026

Is Mamba Effective for Time Series Forecasting?

arXiv 2403.11144 ↗First posted 17 Mar 2024cs.LGcited by 114

On the map: State-space sequence models (S4, Mamba) → Time series forecasting with SSMs

Abstract (arXiv)

In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in TSF, primarily attributed to their advantage in apprehending these patterns. However, the quadratic complexity of the Transformer leads to low computational efficiency and high costs, which somewhat hinders the deployment of the TSF model in real-world scenarios. Recently, Mamba, a selective state space model, has gained traction due to its ability to process dependencies in sequences while maintaining near-linear complexity. For TSF tasks, these characteristics enable Mamba to comprehend hidden patterns as the Transformer and reduce computational overhead compared to the Transformer. Therefore, we propose a Mamba-based model named Simple-Mamba (S-Mamba) for TSF. Specifically, we tokenize the time points of each variate autonomously via a linear layer. A bidirectional Mamba layer is utilized to extract inter-variate correlations and a Feed-Forward Network is set to learn temporal dependencies. Finally, the generation of forecast outcomes through a linear mapping layer. Experiments on thirteen public datasets prove that S-Mamba maintains low computational overhead and achieves leading performance. Furthermore, we conduct extensive experiments to explore Mamba's potential in TSF tasks. Our code is available at https://github.com/wzhwzhwzh0921/S-D-Mamba.

Key facts. Cited by 114 papers in the map (data through 14 Oct 2026). Placed in Time series forecasting with SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 45 of its 75 references that are in the map. First posted on arXiv 17 Mar 2024.

Builds on

45 of 75 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting14 Mar

Other references · 44

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2016Layer Normalizationcited by 5,669
  6. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  7. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  8. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  9. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  10. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  11. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  12. 2020Reformer: The Efficient Transformercited by 1,668
32 more
  1. 2021ViViT: A Video Vision Transformercited by 1,620
  2. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  3. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  4. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  5. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  6. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
  7. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  8. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  9. 2022Simplified State Space Layers for Sequence Modelingcited by 788
  10. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
  11. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
  12. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
  13. 2020Time Series Forecasting With Deep Learning: A Surveycited by 459
  14. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 338
  15. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 332
  16. 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 328
  17. 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 273
  18. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240
  19. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
  20. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 160
  21. 2020Deep Learning for Time Series Forecasting: Tutorial and Literature Surveycited by 117
  22. 2024Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modelingcited by 113
  23. 2024MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathologycited by 88
  24. 2022Flowformer: Linearizing Transformers with Conservation Flowscited by 69
  25. 2024MoE-Mamba: Efficient Selective State Space Models with Mixture of Expertscited by 60
  26. 2024MiM-ISTD: Mamba-in-Mamba for Efficient Infrared Small Target Detectioncited by 60
  27. 2022Transformers in Time-series Analysis: A Tutorialcited by 46
  28. 2023Improving Position Encoding of Transformers for Multivariate Time Series Classificationcited by 45
  29. 2024Is Mamba Capable of In-Context Learning?cited by 45
  30. 2024ClinicalMamba: A Generative Clinical Language Model on Longitudinal Clinical Notescited by 22
  31. 2024MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimationcited by 19
  32. 2024Hierarchical State Space Models for Continuous Sequence-to-Sequence Modelingcited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 27; 2025: 52; 2026: 35.

114 papers.

Sort:

By area:

  1. 2024State Space Model for New-Generation Network Alternative to Transformers: A Surveycited by 59
  2. 2024Mambular: A Sequential Model for Tabular Deep Learningcited by 21
  3. 2024Sports-Traj: A Unified Trajectory Generation Model for Multi-Agent Movement in Sportscited by 19
  4. 2024xLSTM-Mixer: Multivariate Time Series Forecasting by Mixing via Scalar Memoriescited by 19
  5. 2024MADiff: Motion-Aware Mamba Diffusion Models for Hand Trajectory Prediction on Egocentric Videoscited by 18
  6. 2024SSD-TS: Exploring the Potential of Linear State Space Models for Diffusion Models in Time Series Imputationcited by 18
  7. 2025Beyond Sensor Data: Foundation Models of Behavioral Data from Wearables Improve Health Predictionscited by 18
  8. 2024Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Modelscited by 17
  9. 2025AVS-Mamba: Exploring Temporal and Multi-modal Mamba for Audio-Visual Segmentationcited by 16
  10. 2025TimePro: Efficient Multivariate Long-term Time Series Forecasting with Variable- and Time-Aware Hyper-statecited by 16
  11. 2024Bi-Mamba+: Bidirectional Mamba for Time Series Forecastingcited by 15
  12. 2024MambaTS: Improved Selective State Space Models for Long-term Time Series Forecastingcited by 14
38 more
  1. 2024TSCMamba: Mamba Meets Multi-View Learning for Time Series Classificationcited by 10
  2. 2024An Empirical Study of Mamba-based Pedestrian Attribute Recognitioncited by 10
  3. 2024Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecastingcited by 9
  4. 2024CMamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecastingcited by 8
  5. 2025There are no Champions in Supervised Long-Term Time Series Forecastingcited by 8
  6. 2025Novel Diffusion Models for Multimodal 3D Hand Trajectory Predictioncited by 8
  7. 2025ms-Mamba: Multi-scale Mamba for Time-Series Forecastingcited by 8
  8. 2025Block-Biased Mamba for Long-Range Sequence Processingcited by 8
  9. 2025AutoHFormer: Efficient Hierarchical Autoregressive Transformer for Time Series Predictioncited by 8
  10. 2025FlowState: Sampling-Rate-Equivariant Time-Series Forecastingcited by 8
  11. 2025Learning General Causal Structures with Hidden Dynamic Process for Climate Analysiscited by 7
  12. 2025ReFocus: Reinforcing Mid-Frequency and Key-Frequency Modeling for Multivariate Time Series Forecastingcited by 6
  13. 2025S4M: S4 for multivariate time series forecasting with Missing valuescited by 6
  14. 2025Fake-Mamba: Real-Time Speech Deepfake Detection Using Bidirectional Mamba as Self-Attention's Alternativecited by 6
  15. 2024Sequential Order-Robust Mamba for Time Series Forecastingcited by 5
  16. 2025The Alpha-Alternator: Dynamic Adaptation To Varying Noise Levels In Sequences Using The Vendi Score For Improved Robustness and Performancecited by 5
  17. 2025Uni-Hand: Universal Hand Motion Forecasting in Egocentric Viewscited by 5
  18. 2026Enhancing Multivariate Time Series Forecasting with Global Temporal Retrievalcited by 5
  19. 2024FACTS: A Factored State-Space Framework For World Modellingcited by 4
  20. 2024PowerMamba: A Deep State Space Model and Comprehensive Benchmark for Time Series Prediction in Electric Power Systemscited by 4
  21. 2025WSSM: Geographic-enhanced hierarchical state-space model for global station weather forecastcited by 4
  22. 2025Mamba-Based Graph Convolutional Networks: Tackling Over-smoothing with Selective State Spacecited by 4
  23. 2025FLDmamba: Integrating Fourier and Laplace Transform Decomposition with Mamba for Enhanced Time Series Predictioncited by 4
  24. 2025RDIT: Residual-based Diffusion Implicit Models for Probabilistic Time Series Forecastingcited by 4
  25. 2025TimeExpert: Boosting Long Time Series Forecasting with Temporal Mix of Expertscited by 4
  26. 2026MambaSL: Exploring Single-Layer Mamba for Time Series Classificationcited by 4
  27. 2024UmambaTSF: A U-shaped Multi-Scale Long-Term Time Series Forecasting Method Using Mambacited by 3
  28. 2024LiNo: Advancing Recursive Residual Decomposition of Linear and Nonlinear Patterns for Robust Time Series Forecastingcited by 3
  29. 2024GG-SSMs: Graph-Generating State Space Modelscited by 3
  30. 2025BioMamba: Leveraging Spectro-Temporal Embedding in Bidirectional Mamba for Enhanced Biosignal Classificationcited by 3
  31. 2025Channel Normalization for Time Series Channel Identificationcited by 3
  32. 2026Thermal-GEMs: Generalized Models for Building Thermal Dynamicscited by 3
  33. 2026EXAONE Finance 1.0: An Attention-free Time Series Foundation Model for Financial Time Seriescited by 3
  34. 2024miMamba: EEG-based Emotion Recognition with Multi-scale Inverted Mamba Modelscited by 2
  35. 2024Mamba Meets Financial Markets: A Graph-Mamba Approach for Stock Price Predictioncited by 2
  36. 2025Automatic selection of the best neural architecture for time series forecastingcited by 2
  37. 2025Mamba time series forecasting with uncertainty quantificationcited by 2
  38. 2025Technologies on Effectiveness and Efficiency: A Survey of State Spaces Modelscited by 2

50 most cited of 114 All 114 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024A Mamba Foundation Model for Time Series Forecasting
  2. 2024SST: Multi-Scale Hybrid Mamba-Transformer Experts for Time Series Forecasting
  3. 2024FMamba: Mamba based on Fast-attention for Multivariate Time-series Forecasting
  4. 2024Integration of Mamba and Transformer -- MAT for Long-Short Range Time Series Forecasting with Application to Weather Dynamics
  5. 2025ss-Mamba: Semantic-Spline Selective State-Space Model
  6. 2026DMamba: Decomposition-enhanced Mamba for Time Series Forecasting
  7. 2024Mamba or Transformer for Time Series Forecasting? Mixture of Universals (MoU) Is All You Need
  8. 2025DiM-TS: Bridge the Gap between Selective State Space Models and Time Series for Generative Modeling