L2RU: a Structured State Space Model with prescribed L2-bound
On the map: State-space sequence models (S4, Mamba) → Core SSM architectures for language
Abstract (arXiv)
Structured state-space models (SSMs) have recently emerged as a powerful architecture at the intersection of machine learning and control, featuring layers composed of discrete-time linear time-invariant (LTI) systems followed by pointwise nonlinearities. These models combine the expressiveness of deep neural networks with the interpretability and inductive bias of dynamical systems, offering strong performance on long-sequence tasks with favorable computational complexity. However, their adoption in applications such as system identification and optimal control remains limited by the difficulty of enforcing stability and robustness in a principled and tractable manner. We introduce L2RU, a class of SSMs endowed with a prescribed L2-gain bound, guaranteeing input--output stability and robustness for all parameter values. The L2RU architecture is derived from free parametrizations of LTI systems satisfying an L2 constraint, enabling unconstrained optimization via standard gradient-based methods while preserving rigorous stability guarantees. Specifically, we develop two complementary parametrizations: a non-conservative formulation that provides a complete characterization of square LTI systems with a given L2-bound, and a conservative formulation that extends the approach to general (possibly non-square) systems while improving computational efficiency through a structured representation of the system matrices. Both parametrizations admit efficient initialization schemes that facilitate training long-memory models. We demonstrate the effectiveness of the proposed framework on a nonlinear system identification benchmark, where L2RU achieves improved performance and training stability compared to existing SSM architectures, highlighting its potential as a principled and robust building block for learning and control.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Core SSM architectures for language, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 20 of its 27 references that are in the map. First posted on arXiv 31 Mar 2025.
Builds on
20 of 27 references.
Closest ancestors · 4
Same direction, newest first
- 2023Structured state-space models are deep Wiener models11 Dec
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spaces1 Dec
- 2022Simplified State Space Layers for Sequence Modeling9 Aug
- 2021Efficiently Modeling Long Sequences with Structured State Spaces31 Oct
Other references · 16
- 2017Attention Is All You Needcited by 60,361
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 424
- 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 408
- 2020Training robust neural networks using Lipschitz boundscited by 99
- 2023Direct Parameterization of Lipschitz-Bounded Deep Networkscited by 51
- 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustnesscited by 45
- 2024State Space Models as Foundation Models: A Control Theoretic Overviewcited by 19
- 2019Deep Convolutional Networks in System Identificationcited by 17
- 2021On Recurrent Neural Networks for learning-based control: recent results and ideas for future developmentscited by 14
- 2022Robust Classification using Contractive Hamiltonian Neural ODEscited by 13
- 2021Distributed neural network control with dependability guarantees: a compositional port-Hamiltonian approachcited by 12
4 more
- 2019LMI Properties and Applications in Systems, Stability, and Control Theorycited by 11
- 2024Learning to Boost the Performance of Stable Nonlinear Systemscited by 7
- 2023Unconstrained learning of networked nonlinear systems via free parametrization of stable interconnected operatorscited by 4
- 2024Optimal distributed control with stability guarantees by training a network of neural closed-loop mapscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Stable-by-Design Neural Network-Based LPV State-Space Models for System Identification
- 2024HOPE for a Robust Parameterization of Long-memory State Space Models
- 2024Sparse Mamba: Introducing Controllability, Observability, And Stability To Structural State Space Models
- 2026Model-Free Neural Filtering: A Comparison with Classical Filters in Nonlinear Systems
- 2025The Curious Case of In-Training Compression of State Space Models
- 2024Provable Benefits of Complex Parameterizations for Structured State Space Models
- 2026Local Linearity of LLMs Enables Activation Steering via Model-Based Linear Optimal Control
- 2025Design Principles for Sequence Models via Coefficient Dynamics