Model order reduction of deep structured state-space models: A system-theoretic approach
Not on the map. Why?
Abstract (arXiv)
With a specific emphasis on control design objectives, achieving accurate system modeling with limited complexity is crucial in parametric system identification. The recently introduced deep structured state-space models (SSM), which feature linear dynamical blocks as key constituent components, offer high predictive performance. However, the learned representations often suffer from excessively large model orders, which render them unsuitable for control design purposes. The current paper addresses this challenge by means of system-theoretic model order reduction techniques that target the linear dynamical blocks of SSMs. We introduce two regularization terms which can be incorporated into the training loss for improved model order reduction. In particular, we consider modal ℓ1 and Hankel nuclear norm regularization to promote sparsity, allowing one to retain only the relevant states without sacrificing accuracy. The presented regularizers lead to advantages in terms of parsimonious representations and faster inference resulting from the reduced order models. The effectiveness of the proposed methodology is demonstrated using real-world ground vibration data from an aircraft.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 21 Mar 2024.
Builds on
13 of 27 references.
References · 13
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2018Group Normalizationcited by 1,514
- 2022Simplified State Space Layers for Sequence Modelingcited by 776
- 2020Long Range Arena: A Benchmark for Efficient Transformerscited by 696
- 2016Language Modeling with Gated Convolutional Networkscited by 688
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
- 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 397
- 2019Nonlinear System Identification: A User-Oriented Roadmapcited by 55
- 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustnesscited by 43
- 2020dynoNet: a neural network architecture for learning dynamical systemscited by 28
- 2016Identification of block-oriented nonlinear systems starting from linear approximations: A surveycited by 14
- 2015Regularized linear system identification using atomic, nuclear and kernel-based norms: the role of the stability constraintcited by 11
1 more
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 1.
6 papers.
- 2024State Space Model for New-Generation Network Alternative to Transformers: A Surveycited by 59
- 2025The Curious Case of In-Training Compression of State Space Modelscited by 4
- 2025Compression Method for Deep Diagonal State Space Model Based on H2 Optimal Reductioncited by 2
- 2025Hankel Singular Value Regularization for Highly Compressible State Space Modelscited by 2
- 2025A Deep State-Space Model Compression Method using Upper Bound on Output Errorcited by 0
- 2026An Exact Instrument for State Usage in Selective State-Space Models, and the Input-Driven Migration It Revealscited by 0
- 2026An Exact Instrument for State Usage in Selective State-Space Models, and the Input-Driven Migration It Reveals13 Jul 2026
- 2025Hankel Singular Value Regularization for Highly Compressible State Space Models27 Oct 2025
- 2025A Deep State-Space Model Compression Method using Upper Bound on Output Error16 Oct 2025
- 2025The Curious Case of In-Training Compression of State Space Models3 Oct 2025
- 2025Compression Method for Deep Diagonal State Space Model Based on H2 Optimal Reduction14 Jul 2025
- 2024State Space Model for New-Generation Network Alternative to Transformers: A Survey15 Apr 2024
Similar, not cited
Close in wording, no citation either way
- 2026Learning Control-Affine Reduced-Order Models via Autoencoders
- 2022Learning Reduced Nonlinear State-Space Models: an Output-Error Based Canonical Approach
- 2026Reduced-Order Models: The Mother of World Models
- 2022Continuous-time identification of dynamic state-space models by deep subspace encoding
- 2023Structured state-space models are deep Wiener models
- 2026Model-Free Neural Filtering: A Comparison with Classical Filters in Nonlinear Systems
- 2024Provable Benefits of Complex Parameterizations for Structured State Space Models
- 2024An L-BFGS-B approach for linear and nonlinear system identification under ℓ1 and group-Lasso regularization