mlsanityData to 7 Oct 2026

DeMa: Dual-Path Delay-Aware Mamba for Efficient Multivariate Time Series Analysis

arXiv 2601.05527 ↗First posted 9 Jan 2026cs.LG cs.AIcited by 0

On the map: State-space sequence models (S4, Mamba) → Time series forecasting with SSMs

Abstract (arXiv)

Accurate and efficient multivariate time series (MTS) analysis is increasingly critical for a wide range of intelligent applications. Within this realm, Transformers have emerged as the predominant architecture due to their strong ability to capture pairwise dependencies. However, Transformer-based models suffer from quadratic computational complexity and high memory overhead, limiting their scalability and practical deployment in long-term and large-scale MTS modeling. Recently, Mamba has emerged as a promising linear-time alternative with high expressiveness. Nevertheless, directly applying vanilla Mamba to MTS remains suboptimal due to three key limitations: (i) the lack of explicit cross-variate modeling, (ii) difficulty in disentangling the entangled intra-series temporal dynamics and inter-series interactions, and (iii) insufficient modeling of latent time-lag interaction effects. These issues constrain its effectiveness across diverse MTS tasks. To address these challenges, we propose DeMa, a dual-path delay-aware Mamba backbone. DeMa preserves Mamba's linear-complexity advantage while substantially improving its suitability for MTS settings. Specifically, DeMa introduces three key innovations: (i) it decomposes the MTS into intra-series temporal dynamics and inter-series interactions; (ii) it develops a temporal path with a Mamba-SSD module to capture long-range dynamics within each individual series, enabling series-independent, parallel computation; and (iii) it designs a variate path with a Mamba-DALA module that integrates delay-aware linear attention to model cross-variate dependencies. Extensive experiments on five representative tasks, long- and short-term forecasting, data imputation, anomaly detection, and series classification, demonstrate that DeMa achieves state-of-the-art performance while delivering remarkable computational efficiency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Time series forecasting with SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 55 of its 76 references that are in the map. First posted on arXiv 9 Jan 2026.

Builds on

55 of 76 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024CMamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecasting8 Jun
  2. 2024MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting26 May
  3. 2024Is Mamba Effective for Time Series Forecasting?17 Mar

Other references · 52

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  7. 2020Reformer: The Efficient Transformercited by 1,658
  8. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  9. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  10. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
  11. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  12. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
38 more
  1. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  2. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  3. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  4. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
  5. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  6. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
  7. 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 407
  8. 2024Jamba: A Hybrid Transformer-Mamba Language Modelcited by 390
  9. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
  10. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
  11. 2018The UEA multivariate time series classification archive, 2018cited by 330
  12. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
  13. 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 191
  14. 2020A review on outlier/anomaly detection in time series datacited by 187
  15. 2019Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directionscited by 172
  16. 2023FLatten Transformer: Vision Transformer using Focused Linear Attentioncited by 170
  17. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 170
  18. 2023UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecastingcited by 139
  19. 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 136
  20. 2023PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Predictioncited by 135
  21. 2022How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projectionscited by 121
  22. 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 110
  23. 2024Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modelingcited by 108
  24. 2024Demystify Mamba in Vision: A Linear Attention Perspectivecited by 101
  25. 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 100
  26. 2023SegRNN: Segment Recurrent Neural Network for Long-Term Time Series Forecastingcited by 53
  27. 2024MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selectioncited by 40
  28. 2024A Survey of Mambacited by 39
  29. 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendationcited by 35
  30. 2020Time Series Data Imputation: A Survey on Deep Learning Approachescited by 34
  31. 2024Rethinking Channel Dependence for Multivariate Time Series Forecasting: Learning from Leading Indicatorscited by 32
  32. 2024Unveiling Delay Effects in Traffic Forecasting: A Perspective from Spatial-Temporal Delay Differential Equationscited by 11
  33. 2025From Principles to Applications: A Comprehensive Survey of Discrete Tokenizers in Generation, Comprehension, Recommendation, and Information Retrievalcited by 11
  34. 2025Deep Learning for Time Series Forecasting: A Surveycited by 10
  35. 2023LARA: A Light and Anti-overfitting Retraining Approach for Unsupervised Time Series Anomaly Detectioncited by 9
  36. 2024SSD4Rec: A Structured State Space Duality Model for Efficient Sequential Recommendationcited by 9
  37. 2025Diffusion Generative Recommendation with Continuous Tokenscited by 8
  38. 2025HD-Prot: A Protein Language Model for Joint Sequence-Structure Modeling with Continuous Structure Tokenscited by 4

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025DC-Mamber: A Dual Channel Prediction Model based on Mamba and Linear Transformer for Multivariate Time Series Forecasting
  2. 2024SST: Multi-Scale Hybrid Mamba-Transformer Experts for Time Series Forecasting
  3. 2024Integration of Mamba and Transformer -- MAT for Long-Short Range Time Series Forecasting with Application to Weather Dynamics
  4. 2025FLDmamba: Integrating Fourier and Laplace Transform Decomposition with Mamba for Enhanced Time Series Prediction
  5. 2025DiM-TS: Bridge the Gap between Selective State Space Models and Time Series for Generative Modeling
  6. 2026MODE: Efficient Time Series Prediction with Mamba Enhanced by Low-Rank Neural ODEs
  7. 2024A SSM is Polymerized from Multivariate Time Series
  8. 2026DMamba: Decomposition-enhanced Mamba for Time Series Forecasting