mlsanityData to 7 Oct 2026

Model order reduction of deep structured state-space models: A system-theoretic approach

arXiv 2403.14833 ↗First posted 21 Mar 2024cs.LG cs.SY eess.SYcited by 6

Not on the map. Why?

Abstract (arXiv)

With a specific emphasis on control design objectives, achieving accurate system modeling with limited complexity is crucial in parametric system identification. The recently introduced deep structured state-space models (SSM), which feature linear dynamical blocks as key constituent components, offer high predictive performance. However, the learned representations often suffer from excessively large model orders, which render them unsuitable for control design purposes. The current paper addresses this challenge by means of system-theoretic model order reduction techniques that target the linear dynamical blocks of SSMs. We introduce two regularization terms which can be incorporated into the training loss for improved model order reduction. In particular, we consider modal ℓ1 and Hankel nuclear norm regularization to promote sparsity, allowing one to retain only the relevant states without sacrificing accuracy. The presented regularizers lead to advantages in terms of parsimonious representations and faster inference resulting from the reduced order models. The effectiveness of the proposed methodology is demonstrated using real-world ground vibration data from an aircraft.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 21 Mar 2024.

Builds on

13 of 27 references.

References · 13

  1. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  2. 2018Group Normalizationcited by 1,514
  3. 2022Simplified State Space Layers for Sequence Modelingcited by 776
  4. 2020Long Range Arena: A Benchmark for Efficient Transformerscited by 696
  5. 2016Language Modeling with Gated Convolutional Networkscited by 688
  6. 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
  7. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 397
  8. 2019Nonlinear System Identification: A User-Oriented Roadmapcited by 55
  9. 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustnesscited by 43
  10. 2020dynoNet: a neural network architecture for learning dynamical systemscited by 28
  11. 2016Identification of block-oriented nonlinear systems starting from linear approximations: A surveycited by 14
  12. 2015Regularized linear system identification using atomic, nuclear and kernel-based norms: the role of the stability constraintcited by 11
1 more
  1. 2022Learning neural state-space models: do we need a state estimator?cited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 1.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Control-Affine Reduced-Order Models via Autoencoders
  2. 2022Learning Reduced Nonlinear State-Space Models: an Output-Error Based Canonical Approach
  3. 2026Reduced-Order Models: The Mother of World Models
  4. 2022Continuous-time identification of dynamic state-space models by deep subspace encoding
  5. 2023Structured state-space models are deep Wiener models
  6. 2026Model-Free Neural Filtering: A Comparison with Classical Filters in Nonlinear Systems
  7. 2024Provable Benefits of Complex Parameterizations for Structured State Space Models
  8. 2024An L-BFGS-B approach for linear and nonlinear system identification under ℓ1 and group-Lasso regularization