Safely Learning to Control the Constrained Linear Quadratic Regulator
Not on the map. Why?
Abstract (arXiv)
We study the constrained linear quadratic regulator with unknown dynamics, addressing the tension between safety and exploration in data-driven control techniques. We present a framework which allows for system identification through persistent excitation, while maintaining safety by guaranteeing the satisfaction of state and input constraints. This framework involves a novel method for synthesizing robust constraint-satisfying feedback controllers, leveraging newly developed tools from system level synthesis. We connect statistical results with cost sub-optimality bounds to give non-asymptotic guarantees on both estimation and controller performance.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 10; 2022: 8; 2023: 8; 2024: 3; 2025: 0; 2026: 1.
31 papers.
Sort:
By area:
- 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 337
- 2022Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentationcited by 63
- 2022Statistical Learning Theory for Control: A Finite Sample Perspectivecited by 52
- 2021Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challengescited by 40
- 2019On the Global Convergence of Imitation Learning: A Case for Linear Quadratic Regulatorcited by 20
- 2021Task-Optimal Exploration in Linear Dynamical Systemscited by 15
- 2021Safe Autonomous Racing via Approximate Reachability on Ego-visioncited by 13
- 2021Scalable Learning of Safety Guarantees for Autonomous Systems using Hamilton-Jacobi Reachabilitycited by 10
- 2021Safe Adaptive Learning-based Control for Constrained Linear Quadratic Regulators with Regret Guaranteescited by 10
- 2023Learning Dynamical Systems by Leveraging Data from Similar Systemscited by 8
- 2023Learning the Uncertainty Sets for Control Dynamics via Set Membership: A Non-Asymptotic Analysiscited by 6
- 2022Effects of Safety State Augmentation on Safe Explorationcited by 5
19 more
- 2022Safe Reinforcement Learning via Confidence-Based Filterscited by 5
- 2023Online Nonstochastic Control with Adversarial and Static Constraintscited by 5
- 2023Non-asymptotic System Identification for Linear Systems with Nonlinear Policiescited by 5
- 2021Stability-Constrained Markov Decision Processes Using MPCcited by 4
- 2021DESTA: A Framework for Safe Reinforcement Learning with Markov Games of Interventioncited by 4
- 2022Learning-Based Adaptive Control for Stochastic Linear Systems with Input Constraintscited by 3
- 2024Combining Federated Learning and Control: A Surveycited by 2
- 2022Adaptive Robust Model Predictive Control via Uncertainty Cancellationcited by 1
- 2023Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based controlcited by 1
- 2024Exact Recovery Guarantees for Parameterized Nonlinear System Identification Problem under Sparse Disturbances or Semi-Oblivious Attackscited by 1
- 2021Differentiable Robust LQR Layerscited by 0
- 2021Learning Safety Filters for Unknown Discrete-Time Linear Systemscited by 0
- 2022System Identification via Nuclear Norm Regularizationcited by 0
- 2022Learning Nonlinear Couplings in Network of Agents from a Single Sample Trajectorycited by 0
- 2023Safely Learning Dynamical Systemscited by 0
- 2023Finite Time Regret Bounds for Minimum Variance Control of Autoregressive Systems with Exogenous Inputscited by 0
- 2023Learning to Stabilize Online Reinforcement Learning in Unbounded State Spacescited by 0
- 2024Stability properties of gradient flow dynamics for the symmetric low-rank matrix factorization problemcited by 0
- 2026When Can Safe Controllers Adapt? Information before Commitmentcited by 0
- 2026When Can Safe Controllers Adapt? Information before Commitment18 Jul 2026
- 2024Stability properties of gradient flow dynamics for the symmetric low-rank matrix factorization problem24 Nov 2024
- 2024Exact Recovery Guarantees for Parameterized Nonlinear System Identification Problem under Sparse Disturbances or Semi-Oblivious Attacks30 Aug 2024
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2023Learning the Uncertainty Sets for Control Dynamics via Set Membership: A Non-Asymptotic Analysis26 Sep 2023
- 2023Non-asymptotic System Identification for Linear Systems with Nonlinear Policies17 Jun 2023
- 2023Learning to Stabilize Online Reinforcement Learning in Unbounded State Spaces2 Jun 2023
- 2023Finite Time Regret Bounds for Minimum Variance Control of Autoregressive Systems with Exogenous Inputs26 May 2023
- 2023Safely Learning Dynamical Systems20 May 2023
- 2023Learning Dynamical Systems by Leveraging Data from Similar Systems8 Feb 2023
- 2023Online Nonstochastic Control with Adversarial and Static Constraints5 Feb 2023
- 2023Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based control19 Jan 2023
19 more
- 2022Adaptive Robust Model Predictive Control via Uncertainty Cancellation2 Dec 2022
- 2022Learning Nonlinear Couplings in Network of Agents from a Single Sample Trajectory20 Nov 2022
- 2022Learning-Based Adaptive Control for Stochastic Linear Systems with Input Constraints15 Sep 2022
- 2022Statistical Learning Theory for Control: A Finite Sample Perspective12 Sep 2022
- 2022Safe Reinforcement Learning via Confidence-Based Filters4 Jul 2022
- 2022Effects of Safety State Augmentation on Safe Exploration6 Jun 2022
- 2022System Identification via Nuclear Norm Regularization30 Mar 2022
- 2022Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentation14 Feb 2022
- 2021Learning Safety Filters for Unknown Discrete-Time Linear Systems1 Nov 2021
- 2021Safe Adaptive Learning-based Control for Constrained Linear Quadratic Regulators with Regret Guarantees31 Oct 2021
- 2021DESTA: A Framework for Safe Reinforcement Learning with Markov Games of Intervention27 Oct 2021
- 2021Safe Autonomous Racing via Approximate Reachability on Ego-vision14 Oct 2021
- 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learning13 Aug 2021
- 2021Differentiable Robust LQR Layers10 Jun 2021
- 2021Task-Optimal Exploration in Linear Dynamical Systems10 Feb 2021
- 2021Stability-Constrained Markov Decision Processes Using MPC2 Feb 2021
- 2021Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges27 Jan 2021
- 2021Scalable Learning of Safety Guarantees for Autonomous Systems using Hamilton-Jacobi Reachability15 Jan 2021
- 2019On the Global Convergence of Imitation Learning: A Case for Linear Quadratic Regulator11 Jan 2019
- 2021Differentiable Robust LQR Layers10 Jun 2021
- 2019On the Global Convergence of Imitation Learning: A Case for Linear Quadratic Regulator11 Jan 2019
- 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 337
- 2022Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentationcited by 63
- 2022Statistical Learning Theory for Control: A Finite Sample Perspectivecited by 52
- 2021Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challengescited by 40
- 2021Task-Optimal Exploration in Linear Dynamical Systemscited by 15
- 2021Safe Autonomous Racing via Approximate Reachability on Ego-visioncited by 13
- 2021Scalable Learning of Safety Guarantees for Autonomous Systems using Hamilton-Jacobi Reachabilitycited by 10
- 2021Safe Adaptive Learning-based Control for Constrained Linear Quadratic Regulators with Regret Guaranteescited by 10
- 2023Learning Dynamical Systems by Leveraging Data from Similar Systemscited by 8
- 2023Learning the Uncertainty Sets for Control Dynamics via Set Membership: A Non-Asymptotic Analysiscited by 6
- 2022Effects of Safety State Augmentation on Safe Explorationcited by 5
- 2022Safe Reinforcement Learning via Confidence-Based Filterscited by 5
12 most cited of 29 All 29 (JSON)
- 2026When Can Safe Controllers Adapt? Information before Commitment18 Jul 2026
- 2024Stability properties of gradient flow dynamics for the symmetric low-rank matrix factorization problem24 Nov 2024
- 2024Exact Recovery Guarantees for Parameterized Nonlinear System Identification Problem under Sparse Disturbances or Semi-Oblivious Attacks30 Aug 2024
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2023Learning the Uncertainty Sets for Control Dynamics via Set Membership: A Non-Asymptotic Analysis26 Sep 2023
- 2023Non-asymptotic System Identification for Linear Systems with Nonlinear Policies17 Jun 2023
- 2023Learning to Stabilize Online Reinforcement Learning in Unbounded State Spaces2 Jun 2023
- 2023Finite Time Regret Bounds for Minimum Variance Control of Autoregressive Systems with Exogenous Inputs26 May 2023
- 2023Safely Learning Dynamical Systems20 May 2023
- 2023Learning Dynamical Systems by Leveraging Data from Similar Systems8 Feb 2023
- 2023Online Nonstochastic Control with Adversarial and Static Constraints5 Feb 2023
- 2023Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based control19 Jan 2023
12 newest of 29 All 29 (JSON)