mlsanityData to 7 Oct 2026

A Novel Schur-Decomposition-Based Weight Projection Method for Stable State-Space Neural-Network Architectures

arXiv 2605.14489 ↗First posted 14 May 2026cs.LG cs.SY eess.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Building black-box models for dynamical systems from data is a challenging problem in machine learning, especially when asymptotic stability guarantees are required. In this paper, we introduce a novel stability-ensuring and backpropagation-compatible projection scheme based on the Schur decomposition for the state matrix of linear discrete-time state-space layers, as well as an alternative pre-factorized formulation of the methodology. The proposed methods dynamically project the quasi-triangular factor of the state matrix's real Schur decomposition onto its nearest stable peer, ensuring stable dynamics with minimal overparameterization. Experiments on synthetic linear systems demonstrate that, despite a marginal increase in computational complexity, the method achieves accuracy and convergence rates comparable to those of state-of-the-art stable-system identification techniques. Furthermore, the lower weight count facilitates convergence during training without sacrificing accuracy in stacked neural-network architectures with static nonlinearities targeting real-world datasets. These results suggest that the Schur-based projection provides a numerically robust framework for identifying complex dynamics on par with the state of the art while satisfying strict asymptotic-stability requirements.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 47 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

16 of 47 references.

References · 16

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  3. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  5. 2022Simplified State Space Layers for Sequence Modelingcited by 776
  6. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
  7. 2021Modern Koopman Theory for Dynamical Systemscited by 269
  8. 2013Manopt, a Matlab toolbox for optimization on manifoldscited by 112
  9. 2016Pymanopt: A Python Toolbox for Optimization on Manifolds using Automatic Differentiationcited by 93
  10. 2016Identification of block-oriented nonlinear systems starting from linear approximations: A surveycited by 14
  11. 2024An L-BFGS-B approach for linear and nonlinear system identification under ℓ1 and group-Lasso regularizationcited by 8
  12. 2024Baseline Results for Selected Nonlinear System Identification Benchmarkscited by 7
4 more
  1. 2016On computing the distance to stability for matrices using linear dissipative Hamiltonian systemscited by 6
  2. 2018Approximating the nearest stable discrete-time systemcited by 6
  3. 2023SIMBa: System Identification Methods leveraging Backpropagationcited by 5
  4. 2020Nearest Omega-stable matrix via Riemannian optimizationcited by 1

Built on by

Not cited yet.