mlsanityData to 7 Oct 2026

Almost Surely Stable Deep Dynamics

arXiv 2103.14722 ↗First posted 26 Mar 2021cs.LG cs.SY eess.SYcited by 16

Not on the map. Why?

Abstract (arXiv)

We introduce a method for learning provably stable deep neural network based dynamic models from observed data. Specifically, we consider discrete-time stochastic dynamic models, as they are of particular interest in practical applications such as estimation and control. However, these aspects exacerbate the challenge of guaranteeing stability. Our method works by embedding a Lyapunov neural network into the dynamic model, thereby inherently satisfying the stability criterion. To this end, we propose two approaches and apply them in both the deterministic and stochastic settings: one exploits convexity of the Lyapunov function, while the other enforces stability through an implicit output layer. We demonstrate the utility of each approach through numerical examples.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 28 of its 43 references that are in the map. First posted on arXiv 26 Mar 2021.

Builds on

28 of 43 references.

References · 28

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2018Neural Ordinary Differential Equationscited by 3,733
  4. 2018World Modelscited by 1,444
  5. 2019Deep Equilibrium Modelscited by 603
  6. 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
  7. 2015Weight Uncertainty in Neural Networkscited by 554
  8. 2013Generating Sequences With Recurrent Neural Networkscited by 549
  9. 2019Differentiable Convex Optimization Layerscited by 458
  10. 2016Input Convex Neural Networkscited by 407
  11. 2017Safe Model-based Reinforcement Learning with Stability Guaranteescited by 347
  12. 2017Stable Architectures for Deep Neural Networkscited by 340
16 more
  1. 2018A Lyapunov-based Approach to Safe Reinforcement Learningcited by 278
  2. 2020Neural Lyapunov Controlcited by 142
  3. 2019Implicit Deep Learningcited by 124
  4. 2020Learning Stable Deep Dynamics Modelscited by 110
  5. 2018Optimal Control Via Neural Networks: A Convex Approachcited by 82
  6. 2016Gradient Descent Learns Linear Dynamical Systemscited by 78
  7. 2017Reversible Architectures for Arbitrarily Deep Residual Neural Networkscited by 69
  8. 2018Stable Recurrent Modelscited by 65
  9. 2019Neural Networks with Cheap Differential Operatorscited by 18
  10. 2018Stochastic Gradient Descent Learns State Equations with Nonlinear Activationscited by 16
  11. 2018Lyapunov Theory for Discrete Time Systemscited by 15
  12. 2019LSTM Neural Networks: Input to State Stability and Probabilistic Safety Verificationcited by 12
  13. 2020Implicitly Defined Layers in Neural Networkscited by 7
  14. 2018Equilibrium Distributions and Stability Analysis of Gaussian Process State Space Modelscited by 4
  15. 2018Stability of Gaussian Process State Space Modelscited by 2
  16. 2019Lyapunov Criterion for Stochastic Systems and Its Applications in Distributed Computationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 5; 2023: 5; 2024: 1; 2025: 3; 2026: 1.

16 papers.

Sort:

By area: