mlsanityData to 7 Oct 2026

Permutation-Equivariant 2D State Space Models: Theory and Canonical Architecture for Multivariate Time Series

arXiv 2603.08753 ↗First posted 7 Mar 2026stat.ML cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multivariate time series (MTS) modeling often implicitly imposes an artificial ordering over variables, violating the inherent exchangeability found in many real-world systems where no canonical variable axis exists. We formalize this limitation as a violation of the permutation symmetry principle and require state-space dynamics to be permutation-equivariant along the variable axis. In this work, we theoretically characterize the complete canonical form of linear variable coupling under this symmetry constraint. We prove that any permutation-equivariant linear 2D state-space system naturally decomposes into local self-dynamics and a global pooled interaction, rendering ordered recurrence not only unnecessary but structurally suboptimal. Motivated by this theoretical foundation, we introduce the Variable-Invariant Two-Dimensional State Space Model (VI 2D SSM), which realizes the canonical equivariant form via permutation-invariant aggregation. This formulation eliminates sequential dependency chains along the variable axis, reducing the dependency depth from O(C) to O(1) and simplifying stability analysis to two scalar modes. Furthermore, we propose VI 2D Mamba, a unified architecture integrating multi-scale temporal dynamics and spectral representations. Extensive experiments on forecasting, classification, and anomaly detection benchmarks demonstrate that our model achieves state-of-the-art performance with superior structural scalability, validating the theoretical necessity of symmetry-preserving 2D modeling.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 56 references that are in the map. First posted on arXiv 7 Mar 2026.

Builds on

35 of 56 references.

References · 35

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  2. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  4. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  5. 2020Reformer: The Efficient Transformercited by 1,658
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  7. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  8. 2017Deep Setscited by 1,394
  9. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  10. 2016Group Equivariant Convolutional Networkscited by 1,154
  11. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  12. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
23 more
  1. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  2. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  3. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  4. 2022Transformers in Time Series: A Surveycited by 489
  5. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  6. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
  7. 2018The UEA multivariate time series classification archive, 2018cited by 330
  8. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
  9. 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 296
  10. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 158
  11. 2022On The Computational Complexity of Self-Attentioncited by 137
  12. 2024Is Mamba Effective for Time Series Forecasting?cited by 110
  13. 2024SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time seriescited by 81
  14. 2022Flowformer: Linearizing Transformers with Conservation Flowscited by 69
  15. 2025A Comprehensive Survey of Deep Learning for Multivariate Time Series Forecasting: A Channel Strategy Perspectivecited by 58
  16. 20242DMamba: Efficient State Space Model for Image Representation with Applications on Giga-Pixel Whole Slide Image Classificationcited by 35
  17. 2025TimePro: Efficient Multivariate Long-term Time Series Forecasting with Variable- and Time-Aware Hyper-statecited by 16
  18. 2024MambaStock: Selective state space model for stock predictioncited by 13
  19. 2024GrootVL: Tree Topology is All You Need in State Space Modelcited by 13
  20. 2021Deep Efficient Continuous Manifold Learning for Time Series Modelingcited by 10
  21. 2024Chimera: Effectively Modeling Multivariate Time Series with 2-Dimensional State Space Modelscited by 8
  22. 2025ms-Mamba: Multi-scale Mamba for Time-Series Forecastingcited by 7
  23. 2023Deep Geometric Learning with Monotonicity Constraints for Alzheimer's Disease Progressioncited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Unconditional flow-based time series generation with equivariance-regularised latent spaces
  2. 2026SPDM: Geometry-Modulated State Space Modeling with Manifold Constraints for Time Series Forecasting
  3. 2023SE(3) Equivariant Augmented Coupling Flows
  4. 2025DiM-TS: Bridge the Gap between Selective State Space Models and Time Series for Generative Modeling
  5. 2024Long Range Switching Time Series Prediction via State Space Model
  6. 2025Symmetry-Aware Steering of Equivariant Diffusion Policies: Benefits and Limits
  7. 2026Rethinking Diffusion Models with Symmetries through Canonicalization with Applications to Molecular Graph Generation
  8. 2025Towards Stable and Structured Time Series Generation with Perturbation-Aware Flow Matching