mlsanityData to 14 Oct 2026

Regularity and Stability Properties of Selective SSMs with Discontinuous Gating

arXiv 2505.11602 ↗First posted 16 May 2025cs.LG math.DS math.OCcited by 2

On the map: State-space sequence models (S4, Mamba) → Core SSM architectures for language

Abstract (arXiv)

Selective State-Space Models (SSMs) such as Mamba have become central to long-sequence modeling. Still, their stability is poorly understood: their state-space coefficients are modulated online by a token-dependent gating signal, making the recurrence neither linear time-invariant nor classically nonlinear. We study continuous-time selective SSMs through passivity, dissipativity, and Input-to-State Stability (ISS), explicitly separating the selection signal x(·) from the driving input u(·). We obtain four results: exponential forgetting under strict dissipativity; a canonical AUCloc quadratic storage for the frozen-selection subsystem that accommodates discontinuous gating; a parametric LMI together with universal kernel constraints and "irreversible forgetting" under universal quadratic storage; and sufficient conditions for global ISS uniformly over admissible selection schedules. We then bridge to practice by deriving a sampled block LMI for the Mamba selective-scan core, which is used as a differentiable training-time regularizer. Across seven standard time-series datasets and four prediction horizons, the regularizer reduces sampled Mamba-core LMI violations by roughly 92% in 28/28 pairs at a clean-MSE cost of less than 0.018%. It improves internal Mamba passivity and state-norm diagnostics under injected perturbations. Our results turn classical control-theoretic tools into verifiable structural and training criteria for selective SSMs, while honestly scoping which guarantees transfer to a deep selective-scan architecture.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Core SSM architectures for language, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 14 of its 38 references that are in the map. First posted on arXiv 16 May 2025.

Builds on

14 of 38 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024Mamba State-Space Models Are Lyapunov-Stable Learners31 May
  2. 2024Theoretical Foundations of Deep Selective State-Space Models29 Feb
  3. 2023Gated Linear Attention Transformers with Hardware-Efficient Training11 Dec
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spaces1 Dec
  5. 2022Simplified State Space Layers for Sequence Modeling9 Aug
  6. 2021Efficiently Modeling Long Sequences with Structured State Spaces31 Oct

Other references · 8

  1. 2018Neural Ordinary Differential Equationscited by 3,779
  2. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
  3. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 506
  4. 2024HGRN2: Gated Linear RNNs with State Expansioncited by 127
  5. 2024Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theorycited by 19
  6. 2024S7: Selective and Simplified State Space Layers for Sequence Modelingcited by 17
  7. 2024SST: Multi-Scale Hybrid Mamba-Transformer Experts for Time Series Forecastingcited by 16
  8. 2024Dissipative energy functionals of passive linear time-varying systemscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TIDES: Implicit Time-Awareness in Selective State Space Models
  2. 2024Mathematical Formalism for Memory Compression in Selective State Space Models
  3. 2024Demystifying the Token Dynamics of Deep Selective State Space Models
  4. 2026A Theoretical Analysis of Mamba's Training Dynamics: Filtering Relevant Features for Generalization in State Space Models
  5. 2025Geometric SSM: LTI State Space Models for Selective Tasks
  6. 2026Bilinear Input Modulation for Mamba: Koopman Bilinear Forms for Memory Retention and Multiplicative Computation
  7. 2025The Curious Case of In-Training Compression of State Space Models
  8. 2025PerfMamba: Performance Analysis and Pruning of Selective State Space Models