mlsanityData to 7 Oct 2026

Structured state-space models are deep Wiener models

arXiv 2312.06211 ↗First posted 11 Dec 2023eess.SY cs.LG cs.SYcited by 4

On the map: State-space sequence models (S4, Mamba) → Core SSM architectures for language

Abstract (arXiv)

The goal of this paper is to provide a system identification-friendly introduction to the Structured State-space Models (SSMs). These models have become recently popular in the machine learning community since, owing to their parallelizability, they can be efficiently and scalably trained to tackle extremely-long sequence classification and regression problems. Interestingly, SSMs appear as an effective way to learn deep Wiener models, which allows to reframe SSMs as an extension of a model class commonly used in system identification. In order to stimulate a fruitful exchange of ideas between the machine learning and system identification communities, we deem it useful to summarize the recent contributions on the topic in a structured and accessible form. At last, we highlight future research directions for which this community could provide impactful contributions.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Core SSM architectures for language, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 16 of its 30 references that are in the map. First posted on arXiv 11 Dec 2023.

Builds on

16 of 30 references.

Closest ancestors · 3

Same direction, newest first

  1. 2022Simplified State Space Layers for Sequence Modeling9 Aug
  2. 2022Diagonal State Spaces are as Effective as Structured State Spaces27 Mar
  3. 2021Efficiently Modeling Long Sequences with Structured State Spaces31 Oct

Other references · 13

  1. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
  2. 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
  3. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 397
  4. 2017On weight initialization in deep neural networkscited by 67
  5. 2018Stable Recurrent Modelscited by 65
  6. 2019Nonlinear System Identification: A User-Oriented Roadmapcited by 55
  7. 2020dynoNet: a neural network architecture for learning dynamical systemscited by 28
  8. 2019Deep Convolutional Networks in System Identificationcited by 17
  9. 2016Identification of block-oriented nonlinear systems starting from linear approximations: A surveycited by 14
  10. 2021On Recurrent Neural Networks for learning-based control: recent results and ideas for future developmentscited by 14
  11. 2023Nonlinear MPC design for incrementally ISS systems with application to GRU networkscited by 5
  12. 2018Improved Initialization for Nonlinear State-Space Modelingcited by 2
1 more
  1. 2016Wiener system identification with generalized orthonormal basis functionscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Deep Learning-based Approaches for State Space Models: A Selective Review
  2. 2022Learning neural state-space models: do we need a state estimator?
  3. 2025Advancing Intelligent Sequence Modeling: Evolution, Trade-offs, and Applications of State-Space Architectures from S4 to Mamba
  4. 2024State Space Models as Foundation Models: A Control Theoretic Overview
  5. 2024State Space Models are Provably Comparable to Transformers in Dynamic Token Selection
  6. 2024Provable Benefits of Complex Parameterizations for Structured State Space Models
  7. 2023Spectral State Space Models
  8. 2026A Simple State Space Model Excels at Multivariate Time Series Classification