mlsanityData to 14 Oct 2026

Controllability-Constrained Deep Network Models for Enhanced Control of Dynamical Systems

arXiv 2311.06438 ↗First posted 11 Nov 2023eess.SY cs.AI cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Control of a dynamical system without the knowledge of dynamics is an important and challenging task. Modern machine learning approaches, such as deep neural networks (DNNs), allow for the estimation of a dynamics model from control inputs and corresponding state observation outputs. Such data-driven models are often utilized for the derivation of model-based controllers. However, in general, there are no guarantees that a model represented by DNNs will be controllable according to the formal control-theoretical meaning of controllability, which is crucial for the design of effective controllers. This often precludes the use of DNN-estimated models in applications, where formal controllability guarantees are required. In this proof-of-the-concept work, we propose a control-theoretical method that explicitly enhances models estimated from data with controllability. That is achieved by augmenting the model estimation objective with a controllability constraint, which penalizes models with a low degree of controllability. As a result, the models estimated with the proposed controllability constraint allow for the derivation of more efficient controllers, they are interpretable by the control-theoretical quantities and have a lower long-term prediction error. The proposed method provides new insights on the connection between the DNN-based estimation of unknown dynamics and the control-theoretical guarantees of the solution properties. We demonstrate the superiority of the proposed method in two standard classical control systems with state observation given by low resolution high-dimensional images.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 34 references that are in the map. First posted on arXiv 11 Nov 2023.

Builds on

10 of 34 references.

References · 10

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2016OpenAI Gymcited by 1,736
  3. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  4. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  5. 2015Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Imagescited by 274
  6. 2018Variational Discriminator Bottleneck: Improving Imitation Learning, Inverse RL, and GANs by Constraining Information Flowcited by 105
  7. 2017Deep Learning in Robotics: A Review of Recent Researchcited by 43
  8. 2017Robust Locally-Linear Controllable Embeddingcited by 38
  9. 2014Learning to Generate Chairs, Tables and Cars with Convolutional Networkscited by 26
  10. 2019Prediction, Consistency, Curvature: Representation Learning for Locally-Linear Controlcited by 18

Built on by

Not cited yet.