Learning to Boost the Performance of Stable Nonlinear Systems
Not on the map. Why?
Abstract (arXiv)
The growing scale and complexity of safety-critical control systems underscore the need to evolve current control architectures aiming for the unparalleled performances achievable through state-of-the-art optimization and machine learning algorithms. However, maintaining closed-loop stability while boosting the performance of nonlinear control systems using data-driven and deep-learning approaches stands as an important unsolved challenge. In this paper, we tackle the performance-boosting problem with closed-loop stability guarantees. Specifically, we establish a synergy between the Internal Model Control (IMC) principle for nonlinear systems and state-of-the-art unconstrained optimization approaches for learning stable dynamics. Our methods enable learning over arbitrarily deep neural network classes of performance-boosting controllers for stable nonlinear systems; crucially, we guarantee L_p closed-loop stability even if optimization is halted prematurely, and even when the ground-truth dynamics are unknown, with vanishing conservatism in the class of stabilizing policies as the model uncertainty is reduced to zero. We discuss the implementation details of the proposed control schemes, including distributed ones, along with the corresponding optimization procedures, demonstrating the potential of freely shaping the cost functions through several numerical experiments.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 42 of its 66 references that are in the map. First posted on arXiv 1 May 2024.
Builds on
42 of 66 references.
References · 42
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019Deep Equilibrium Modelscited by 615
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 604
- 2019Control Barrier Functions: Theory and Applicationscited by 372
- 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 371
- 2017Safe Model-based Reinforcement Learning with Stability Guaranteescited by 366
- 2018Global Convergence of Policy Gradient Methods for the Linear Quadratic Regulatorcited by 250
- 2017On the Sample Complexity of the Linear Quadratic Regulatorcited by 159
- 2018A predictive safety filter for learning-based control of constrained nonlinear dynamical systemscited by 118
- 2016Reinforcement Learning With Temporal Logic Rewardscited by 117
- 2019Safe Reinforcement Learning Using Robust MPCcited by 85
- 2021Autonomous Drone Racing with Deep Reinforcement Learningcited by 60
30 more
- 2020Backpropagation through Signal Temporal Logic Specifications: Infusing Logical Structure into Gradient-Based Methodscited by 54
- 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustnesscited by 45
- 2018Stability-certified reinforcement learning: A control-theoretic perspectivecited by 31
- 2021Analysis of the Optimization Landscape of Linear Quadratic Gaussian (LQG) Controlcited by 28
- 2021Lessons from AlphaZero for Optimal, Model Predictive, and Adaptive Controlcited by 25
- 2020Sample Complexity of Linear Quadratic Gaussian (LQG) Control for Output Feedback Systemscited by 16
- 2021Recurrent Neural Network Controllers Synthesis with Stability Guarantees for Partially Observed Systemscited by 16
- 2020A Neural Network Approach Applied to Multi-Agent Optimal Controlcited by 14
- 2021Learning over All Stabilizing Nonlinear Controllers for a Partially-Observed Linear Systemcited by 14
- 2021Distributed neural network control with dependability guarantees: a compositional port-Hamiltonian approachcited by 12
- 2022Neural System Level Synthesis: Learning over All Stabilizing Policies for Nonlinear Systemscited by 11
- 2020Offset-free setpoint tracking using neural network controllerscited by 10
- 2021Youla-REN: Learning Nonlinear Feedback Policies with Robust Stability Guaranteescited by 10
- 2016A System Level Approach to Controller Synthesiscited by 9
- 2023Unconstrained Parametrization of Dissipative and Contracting Neural Ordinary Differential Equationscited by 8
- 2024Learning to optimize with convergence guarantees using nonlinear system theorycited by 7
- 2024A PAC-Bayesian Framework for Optimal Control with Stability Guaranteescited by 7
- 2023Learning Over Contracting and Lipschitz Closed-Loops for Partially-Observed Nonlinear Systems (Extended Version)cited by 6
- 2019Sparsity Invariance for Convex Design of Distributed Controllerscited by 5
- 2021Recurrent Neural Network-based Internal Model Control design for stable nonlinear systemscited by 5
- 2019First Order Methods For Globally Optimal Distributed Controllers Beyond Quadratic Invariancecited by 4
- 2020A System Level Approach to Discrete-Time Nonlinear Systemscited by 4
- 2023Unconstrained learning of networked nonlinear systems via free parametrization of stable interconnected operatorscited by 4
- 2024Neural Distributed Controllers with Port-Hamiltonian Structurescited by 4
- 2024Optimal distributed control with stability guarantees by training a network of neural closed-loop mapscited by 4
- 2019An Input-Output Parametrization of Stabilizing Controllers: amidst Youla and System Level Synthesiscited by 3
- 2022Approximation by Simple Poles -- Part I: Density and Geometric Convergence Rate in Hardy Spacecited by 2
- 2019System-level, Input-output and New Parameterizations of Stabilizing Controllers, and Their Numerical Computationcited by 1
- 2022Approximation by Simple Poles -- Part II: System Level Synthesis Beyond Finite Impulse Responsecited by 1
- 2022Nonlinear System Level Synthesis for Polynomial Dynamical Systemscited by 1
Built on by
Citing papers per year: 2025: 5; 2026: 2.
7 papers.
- 2025R2DN: Scalable Parameterization of Contracting and Lipschitz Recurrent Deep Networkscited by 2
- 2025L2RU: a Structured State Space Model with prescribed L2-boundcited by 1
- 2025MAD: A Magnitude And Direction Policy Parametrization for Stability Constrained Reinforcement Learningcited by 1
- 2026Controller Design for Structured State-space Models via Contraction Theorycited by 1
- 2025Recurrent neural network-based robust control systems with regional properties and application to MPC designcited by 0
- 2025Distributed Control of Network Systems in the Space of Stabilizing Graph Neural Network Policiescited by 0
- 2026Stability-Preserving Online Adaptation of Neural Closed-loop Mapscited by 0
- 2026Controller Design for Structured State-space Models via Contraction Theory8 Apr 2026
- 2026Stability-Preserving Online Adaptation of Neural Closed-loop Maps23 Mar 2026
- 2025Distributed Control of Network Systems in the Space of Stabilizing Graph Neural Network Policies20 Dec 2025
- 2025Recurrent neural network-based robust control systems with regional properties and application to MPC design25 Jun 2025
- 2025MAD: A Magnitude And Direction Policy Parametrization for Stability Constrained Reinforcement Learning3 Apr 2025
- 2025R2DN: Scalable Parameterization of Contracting and Lipschitz Recurrent Deep Networks1 Apr 2025
- 2025L2RU: a Structured State Space Model with prescribed L2-bound31 Mar 2025