A Novel Schur-Decomposition-Based Weight Projection Method for Stable State-Space Neural-Network Architectures
Not on the map. Why?
Abstract (arXiv)
Building black-box models for dynamical systems from data is a challenging problem in machine learning, especially when asymptotic stability guarantees are required. In this paper, we introduce a novel stability-ensuring and backpropagation-compatible projection scheme based on the Schur decomposition for the state matrix of linear discrete-time state-space layers, as well as an alternative pre-factorized formulation of the methodology. The proposed methods dynamically project the quasi-triangular factor of the state matrix's real Schur decomposition onto its nearest stable peer, ensuring stable dynamics with minimal overparameterization. Experiments on synthetic linear systems demonstrate that, despite a marginal increase in computational complexity, the method achieves accuracy and convergence rates comparable to those of state-of-the-art stable-system identification techniques. Furthermore, the lower weight count facilitates convergence during training without sacrificing accuracy in stacked neural-network architectures with static nonlinearities targeting real-world datasets. These results suggest that the Schur-based projection provides a numerically robust framework for identifying complex dynamics on par with the state of the art while satisfying strict asymptotic-stability requirements.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 47 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
16 of 47 references.
References · 16
- 2017Attention Is All You Needcited by 59,932
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2022Simplified State Space Layers for Sequence Modelingcited by 776
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
- 2021Modern Koopman Theory for Dynamical Systemscited by 269
- 2013Manopt, a Matlab toolbox for optimization on manifoldscited by 112
- 2016Pymanopt: A Python Toolbox for Optimization on Manifolds using Automatic Differentiationcited by 93
- 2016Identification of block-oriented nonlinear systems starting from linear approximations: A surveycited by 14
- 2024An L-BFGS-B approach for linear and nonlinear system identification under ℓ1 and group-Lasso regularizationcited by 8
- 2024Baseline Results for Selected Nonlinear System Identification Benchmarkscited by 7
4 more
- 2016On computing the distance to stability for matrices using linear dissipative Hamiltonian systemscited by 6
- 2018Approximating the nearest stable discrete-time systemcited by 6
- 2023SIMBa: System Identification Methods leveraging Backpropagationcited by 5
- 2020Nearest Omega-stable matrix via Riemannian optimizationcited by 1
Built on by
Not cited yet.