Almost Surely Stable Deep Dynamics
Not on the map. Why?
Abstract (arXiv)
We introduce a method for learning provably stable deep neural network based dynamic models from observed data. Specifically, we consider discrete-time stochastic dynamic models, as they are of particular interest in practical applications such as estimation and control. However, these aspects exacerbate the challenge of guaranteeing stability. Our method works by embedding a Lyapunov neural network into the dynamic model, thereby inherently satisfying the stability criterion. To this end, we propose two approaches and apply them in both the deterministic and stochastic settings: one exploits convexity of the Lyapunov function, while the other enforces stability through an implicit output layer. We demonstrate the utility of each approach through numerical examples.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 28 of its 43 references that are in the map. First posted on arXiv 26 Mar 2021.
Builds on
28 of 43 references.
References · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2018World Modelscited by 1,444
- 2019Deep Equilibrium Modelscited by 603
- 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
- 2015Weight Uncertainty in Neural Networkscited by 554
- 2013Generating Sequences With Recurrent Neural Networkscited by 549
- 2019Differentiable Convex Optimization Layerscited by 458
- 2016Input Convex Neural Networkscited by 407
- 2017Safe Model-based Reinforcement Learning with Stability Guaranteescited by 347
- 2017Stable Architectures for Deep Neural Networkscited by 340
16 more
- 2018A Lyapunov-based Approach to Safe Reinforcement Learningcited by 278
- 2020Neural Lyapunov Controlcited by 142
- 2019Implicit Deep Learningcited by 124
- 2020Learning Stable Deep Dynamics Modelscited by 110
- 2018Optimal Control Via Neural Networks: A Convex Approachcited by 82
- 2016Gradient Descent Learns Linear Dynamical Systemscited by 78
- 2017Reversible Architectures for Arbitrarily Deep Residual Neural Networkscited by 69
- 2018Stable Recurrent Modelscited by 65
- 2019Neural Networks with Cheap Differential Operatorscited by 18
- 2018Stochastic Gradient Descent Learns State Equations with Nonlinear Activationscited by 16
- 2018Lyapunov Theory for Discrete Time Systemscited by 15
- 2019LSTM Neural Networks: Input to State Stability and Probabilistic Safety Verificationcited by 12
- 2020Implicitly Defined Layers in Neural Networkscited by 7
- 2018Equilibrium Distributions and Stability Analysis of Gaussian Process State Space Modelscited by 4
- 2018Stability of Gaussian Process State Space Modelscited by 2
- 2019Lyapunov Criterion for Stochastic Systems and Its Applications in Distributed Computationcited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 5; 2024: 1; 2025: 3; 2026: 1.
16 papers.
Sort:
By area:
- 2021Stability Verification in Stochastic Control Systems via Neural Network Supermartingalescited by 24
- 2022Learning Control Policies for Stochastic Systems with Reach-avoid Guaranteescited by 21
- 2025Stable Port-Hamiltonian Neural Networkscited by 13
- 2022No More Pesky Hyperparameters: Offline Hyperparameter Tuning for RLcited by 6
- 2023Scalable and Efficient Continual Learning from Demonstration via a Hypernetwork-generated Stable Dynamics Modelcited by 6
- 2025MPCritic: A plug-and-play MPC architecture for reinforcement learningcited by 3
- 2022Learning Stabilizable Deep Dynamics Modelscited by 2
- 2022Learning Deep Input-Output Stable Dynamicscited by 2
- 2023Stabilizing reinforcement learning control: A modular framework for optimizing over all stable behaviorcited by 2
- 2024Stable Autonomous Flow Matchingcited by 2
- 2022The Underlying Correlated Dynamics in Neural Trainingcited by 1
- 2023A modular framework for stabilizing deep reinforcement learning controlcited by 1
4 more
- 2023A Policy Optimization Method Towards Optimal-time Stabilitycited by 0
- 2023Efficient Exploration Using Extra Safety Budget in Constrained Policy Optimizationcited by 0
- 2025LILAD: Learning In-context Lyapunov-stable Adaptive Dynamics Modelscited by 0
- 2026Atoms to Processes: The Role of Artificial Intelligence and Machine Learning in Chemical Engineeringcited by 0
- 2026Atoms to Processes: The Role of Artificial Intelligence and Machine Learning in Chemical Engineering1 Oct 2026
- 2025LILAD: Learning In-context Lyapunov-stable Adaptive Dynamics Models26 Nov 2025
- 2025MPCritic: A plug-and-play MPC architecture for reinforcement learning1 Apr 2025
- 2025Stable Port-Hamiltonian Neural Networks4 Feb 2025
- 2024Stable Autonomous Flow Matching8 Feb 2024
- 2023Scalable and Efficient Continual Learning from Demonstration via a Hypernetwork-generated Stable Dynamics Model6 Nov 2023
- 2023Stabilizing reinforcement learning control: A modular framework for optimizing over all stable behavior21 Oct 2023
- 2023A modular framework for stabilizing deep reinforcement learning control7 Apr 2023
- 2023Efficient Exploration Using Extra Safety Budget in Constrained Policy Optimization28 Feb 2023
- 2023A Policy Optimization Method Towards Optimal-time Stability2 Jan 2023
- 2022The Underlying Correlated Dynamics in Neural Training18 Dec 2022
- 2022Learning Control Policies for Stochastic Systems with Reach-avoid Guarantees11 Oct 2022
4 more
- 2022Learning Deep Input-Output Stable Dynamics27 Jun 2022
- 2022No More Pesky Hyperparameters: Offline Hyperparameter Tuning for RL18 May 2022
- 2022Learning Stabilizable Deep Dynamics Models18 Mar 2022
- 2021Stability Verification in Stochastic Control Systems via Neural Network Supermartingales17 Dec 2021
- 2024Stable Autonomous Flow Matchingcited by 2
- 2024Stable Autonomous Flow Matching8 Feb 2024
- 2021Stability Verification in Stochastic Control Systems via Neural Network Supermartingalescited by 24
- 2022Learning Control Policies for Stochastic Systems with Reach-avoid Guaranteescited by 21
- 2025Stable Port-Hamiltonian Neural Networkscited by 13
- 2022No More Pesky Hyperparameters: Offline Hyperparameter Tuning for RLcited by 6
- 2025MPCritic: A plug-and-play MPC architecture for reinforcement learningcited by 3
- 2022Learning Stabilizable Deep Dynamics Modelscited by 2
- 2022Learning Deep Input-Output Stable Dynamicscited by 2
- 2023Stabilizing reinforcement learning control: A modular framework for optimizing over all stable behaviorcited by 2
- 2022The Underlying Correlated Dynamics in Neural Trainingcited by 1
- 2023A modular framework for stabilizing deep reinforcement learning controlcited by 1
- 2023A Policy Optimization Method Towards Optimal-time Stabilitycited by 0
- 2023Efficient Exploration Using Extra Safety Budget in Constrained Policy Optimizationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Atoms to Processes: The Role of Artificial Intelligence and Machine Learning in Chemical Engineering1 Oct 2026
- 2025LILAD: Learning In-context Lyapunov-stable Adaptive Dynamics Models26 Nov 2025
- 2025MPCritic: A plug-and-play MPC architecture for reinforcement learning1 Apr 2025
- 2025Stable Port-Hamiltonian Neural Networks4 Feb 2025
- 2023Stabilizing reinforcement learning control: A modular framework for optimizing over all stable behavior21 Oct 2023
- 2023A modular framework for stabilizing deep reinforcement learning control7 Apr 2023
- 2023Efficient Exploration Using Extra Safety Budget in Constrained Policy Optimization28 Feb 2023
- 2023A Policy Optimization Method Towards Optimal-time Stability2 Jan 2023
- 2022The Underlying Correlated Dynamics in Neural Training18 Dec 2022
- 2022Learning Control Policies for Stochastic Systems with Reach-avoid Guarantees11 Oct 2022
- 2022Learning Deep Input-Output Stable Dynamics27 Jun 2022
- 2022No More Pesky Hyperparameters: Offline Hyperparameter Tuning for RL18 May 2022
12 newest of 14 All 14 (JSON)