Learning Linear-Quadratic Regulators Efficiently with only √T Regret
Not on the map. Why?
Abstract (arXiv)
We present the first computationally-efficient algorithm with widetilde O(√T) regret for learning in Linear Quadratic Control systems with unknown dynamics. By that, we resolve an open question of Abbasi-Yadkori and Szepesv'ari (2011) and Dean, Mania, Matni, Recht, and Tu (2018).
Key facts. Cited by 70 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 13; 2023: 9; 2024: 12; 2025: 10; 2026: 8.
70 papers.
Sort:
By area:
- 2022Statistical Learning Theory for Control: A Finite Sample Perspectivecited by 53
- 2021Stabilizing Dynamical Systems via Policy Gradient Methodscited by 25
- 2021A Free Lunch from the Noise: Provable and Practical Exploration for Representation Learningcited by 24
- 2023Optimal Exploration for Model-Based RL in Nonlinear Systemscited by 18
- 2021Lazy OCO: Online Convex Optimization on a Switching Budgetcited by 14
- 2021PC-MLP: Model-based Reinforcement Learning with Policy Cover Guided Explorationcited by 14
- 2023Rate-Optimal Policy Optimization for Linear Markov Decision Processescited by 14
- 2022Online Control of Unknown Time-Varying Dynamical Systemscited by 13
- 2021Online Policy Gradient for Model Free Learning of Linear Quadratic Regulators with √T Regretcited by 12
- 2024Sublinear Regret for a Class of Continuous-Time Linear-Quadratic Reinforcement Learning Problemscited by 12
- 2025Optimistically Optimistic Exploration for Provably Efficient Infinite-Horizon Reinforcement and Imitation Learningcited by 12
- 2022Regret Lower Bounds for Learning Linear Quadratic Gaussian Systemscited by 11
38 more
- 2021Regret-optimal Estimation and Controlcited by 10
- 2024Near-Optimal Regret in Linear MDPs with Aggregate Bandit Feedbackcited by 10
- 2021Sparsity in Partially Controllable Linear Systemscited by 9
- 2022Global Convergence of Two-timescale Actor-Critic for Solving Linear Quadratic Regulatorcited by 8
- 2021On the Sample Complexity of Decentralized Linear Quadratic Regulator with Partially Nested Information Structurecited by 7
- 2025SOMBRL: Scalable and Optimistic Model-Based RLcited by 7
- 2021Regret Analysis of Distributed Online LQR Control for Unknown LTI Systemscited by 6
- 2022Optimal scheduling of entropy regulariser for continuous-time linear-quadratic reinforcement learningcited by 6
- 2022Best of Both Worlds in Online Control: Competitive Ratio and Policy Regretcited by 6
- 2023Nonasymptotic Regret Analysis of Adaptive Linear Quadratic Control with Model Misspecificationcited by 6
- 2024No-Regret Reinforcement Learning in Smooth MDPscited by 6
- 2025The Sample Complexity of Online Reinforcement Learning: A Multi-model Perspectivecited by 6
- 2025Universal Sequence Preconditioningcited by 6
- 2021Regret Analysis of Learning-Based MPC with Partially-Unknown Cost Functioncited by 5
- 2021Exponential Family Model-Based Reinforcement Learning via Score Matchingcited by 5
- 2022Rate-Optimal Online Convex Optimization in Adaptive Linear Controlcited by 5
- 2022Meta-Learning Online Control for Linear Dynamical Systemscited by 5
- 2024Projection by Convolution: Optimal Sample Complexity for Reinforcement Learning in Continuous-Space MDPscited by 5
- 2025IL-SOAR : Imitation Learning with Soft Optimistic Actor cRiticcited by 5
- 2025Policy Gradient Adaptive Control for the LQR: Indirect and Direct Approachescited by 5
- 2021Finite-time System Identification and Adaptive Control in Autoregressive Exogenous Systemscited by 4
- 2022Efficient Online Linear Control with Stochastic Convex Costs and Unknown Dynamicscited by 4
- 2024NeoRL: Efficient Exploration for Nonepisodic RLcited by 4
- 2024Regret Analysis of Multi-task Representation Learning for Linear-Quadratic Adaptive Controlcited by 4
- 2024Local Linearity: the Key for No-regret Reinforcement Learning in Continuous MDPscited by 4
- 2021Online Learning for Predictive Control with Provable Regret Guaranteescited by 3
- 2024Combining Federated Learning and Control: A Surveycited by 3
- 2021Scalable regret for learning to control network-coupled subsystems with unknown dynamicscited by 2
- 2022Optimal Competitive-Ratio Controlcited by 2
- 2023Near-continuous time Reinforcement Learning for continuous state-action spacescited by 2
- 2023Best of Both Worlds Guarantees for Smoothed Online Quadratic Optimizationcited by 2
- 2024Learning to Stabilize Unknown LTI Systems on a Single Trajectory under Stochastic Noisecited by 2
- 2025A New Approach to Controlling Linear Dynamical Systemscited by 2
- 2025Global Optimality of Single-Timescale Actor-Critic under Continuous State-Action Space: A Study on Linear Quadratic Regulatorcited by 2
- 2021A relaxed technical assumption for posterior sampling-based reinforcement learning for control of unknown linear systemscited by 1
- 2022Learning Decentralized Linear Quadratic Regulators with √T Regretcited by 1
- 2023Regret Analysis of Distributed Online Control for LTI Systems with Adversarial Disturbancescited by 1
- 2023On the Hardness of Learning to Stabilize Linear Systemscited by 1
50 most cited of 70 All 70 (JSON)
- 2026Block Optimism for Nonstationary Bandits with Latent Linear Dynamics1 Oct 2026
- 2026Consistent Model Chasing Is Minimax Optimal: The Exact Value of Scalar Adversarial Adaptive Control under Large Parametric Uncertainty13 Aug 2026
- 2026A Spectral Filtering Approach to Regret Analysis of Distributed Online Control for Linear Dynamical Systems3 Aug 2026
- 2026When Can Safe Controllers Adapt? Information before Commitment18 Jul 2026
- 2026Optimistic Online LQR via Intrinsic Rewards30 Mar 2026
- 2026Multi-agent imitation learning with function approximation: Linear Markov games and beyond26 Feb 2026
- 2026Model-Free Output Feedback Stabilization via Policy Gradient Methods27 Jan 2026
- 2026Adaptive Control of Unknown Linear Switched Systems via Policy Gradient Methods6 Jan 2026
- 2025SOMBRL: Scalable and Optimistic Model-Based RL25 Nov 2025
- 2025Adversarially Robust Multitask Adaptive Control7 Nov 2025
- 2025Efficient Spectral Control of Partially Observed Linear Dynamical Systems27 May 2025
- 2025Policy Gradient Adaptive Control for the LQR: Indirect and Direct Approaches6 May 2025
38 more
- 2025Global Optimality of Single-Timescale Actor-Critic under Continuous State-Action Space: A Study on Linear Quadratic Regulator2 May 2025
- 2025A New Approach to Controlling Linear Dynamical Systems4 Apr 2025
- 2025IL-SOAR : Imitation Learning with Soft Optimistic Actor cRitic27 Feb 2025
- 2025Optimistically Optimistic Exploration for Provably Efficient Infinite-Horizon Reinforcement and Imitation Learning19 Feb 2025
- 2025Universal Sequence Preconditioning10 Feb 2025
- 2025The Sample Complexity of Online Reinforcement Learning: A Multi-model Perspective27 Jan 2025
- 2024Local Linearity: the Key for No-regret Reinforcement Learning in Continuous MDPs31 Oct 2024
- 2024Sublinear Regret for a Class of Continuous-Time Linear-Quadratic Reinforcement Learning Problems24 Jul 2024
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2024Regret Analysis of Multi-task Representation Learning for Linear-Quadratic Adaptive Control8 Jul 2024
- 2024NeoRL: Efficient Exploration for Nonepisodic RL3 Jun 2024
- 2024Learning to Stabilize Unknown LTI Systems on a Single Trajectory under Stochastic Noise31 May 2024
- 2024Model-Agnostic Zeroth-Order Policy Optimization for Meta-Learning of Ergodic Linear Quadratic Regulators27 May 2024
- 2024Near-Optimal Regret in Linear MDPs with Aggregate Bandit Feedback13 May 2024
- 2024Projection by Convolution: Optimal Sample Complexity for Reinforcement Learning in Continuous-Space MDPs10 May 2024
- 2024Optimistic Safety for Online Convex Optimization with Unknown Linear Constraints9 Mar 2024
- 2024Stability-Certified On-Policy Data-Driven LQR via Recursive Learning and Policy Gradient8 Mar 2024
- 2024No-Regret Reinforcement Learning in Smooth MDPs6 Feb 2024
- 2023Nonasymptotic Regret Analysis of Adaptive Linear Quadratic Control with Model Misspecification29 Dec 2023
- 2023On the Hardness of Learning to Stabilize Linear Systems18 Nov 2023
- 2023Best of Both Worlds Guarantees for Smoothed Online Quadratic Optimization31 Oct 2023
- 2023Regret Analysis of Distributed Online Control for LTI Systems with Adversarial Disturbances4 Oct 2023
- 2023Near-continuous time Reinforcement Learning for continuous state-action spaces6 Sep 2023
- 2023Rate-Optimal Policy Optimization for Linear Markov Decision Processes28 Aug 2023
- 2023Optimal Exploration for Model-Based RL in Nonlinear Systems15 Jun 2023
- 2023Finite Time Regret Bounds for Minimum Variance Control of Autoregressive Systems with Exogenous Inputs26 May 2023
- 2023Almost Surely √T Regret for Adaptive LQR13 Jan 2023
- 2022Best of Both Worlds in Online Control: Competitive Ratio and Policy Regret21 Nov 2022
- 2022Learning Decentralized Linear Quadratic Regulators with √T Regret17 Oct 2022
- 2022Statistical Learning Theory for Control: A Finite Sample Perspective12 Sep 2022
- 2022Meta-Learning Online Control for Linear Dynamical Systems18 Aug 2022
- 2022Global Convergence of Two-timescale Actor-Critic for Solving Linear Quadratic Regulator18 Aug 2022
- 2022Optimal scheduling of entropy regulariser for continuous-time linear-quadratic reinforcement learning8 Aug 2022
- 2022Learning to Control under Time-Varying Environment6 Jun 2022
- 2022Optimal Competitive-Ratio Control3 Jun 2022
- 2022Rate-Optimal Online Convex Optimization in Adaptive Linear Control3 Jun 2022
- 2022Efficient Online Linear Control with Stochastic Convex Costs and Unknown Dynamics2 Mar 2022
- 2022Online Control of Unknown Time-Varying Dynamical Systems16 Feb 2022
50 newest of 70 All 70 (JSON)
- 2024Sublinear Regret for a Class of Continuous-Time Linear-Quadratic Reinforcement Learning Problemscited by 12
- 2024Near-Optimal Regret in Linear MDPs with Aggregate Bandit Feedbackcited by 10
- 2025SOMBRL: Scalable and Optimistic Model-Based RLcited by 7
- 2024No-Regret Reinforcement Learning in Smooth MDPscited by 6
- 2025The Sample Complexity of Online Reinforcement Learning: A Multi-model Perspectivecited by 6
- 2024Projection by Convolution: Optimal Sample Complexity for Reinforcement Learning in Continuous-Space MDPscited by 5
- 2025Policy Gradient Adaptive Control for the LQR: Indirect and Direct Approachescited by 5
- 2024NeoRL: Efficient Exploration for Nonepisodic RLcited by 4
- 2024Local Linearity: the Key for No-regret Reinforcement Learning in Continuous MDPscited by 4
- 2025Global Optimality of Single-Timescale Actor-Critic under Continuous State-Action Space: A Study on Linear Quadratic Regulatorcited by 2
- 2024Stability-Certified On-Policy Data-Driven LQR via Recursive Learning and Policy Gradientcited by 1
- 2026Model-Free Output Feedback Stabilization via Policy Gradient Methodscited by 1
12 most cited of 14 All 14 (JSON)
- 2026Optimistic Online LQR via Intrinsic Rewards30 Mar 2026
- 2026Model-Free Output Feedback Stabilization via Policy Gradient Methods27 Jan 2026
- 2026Adaptive Control of Unknown Linear Switched Systems via Policy Gradient Methods6 Jan 2026
- 2025SOMBRL: Scalable and Optimistic Model-Based RL25 Nov 2025
- 2025Policy Gradient Adaptive Control for the LQR: Indirect and Direct Approaches6 May 2025
- 2025Global Optimality of Single-Timescale Actor-Critic under Continuous State-Action Space: A Study on Linear Quadratic Regulator2 May 2025
- 2025The Sample Complexity of Online Reinforcement Learning: A Multi-model Perspective27 Jan 2025
- 2024Local Linearity: the Key for No-regret Reinforcement Learning in Continuous MDPs31 Oct 2024
- 2024Sublinear Regret for a Class of Continuous-Time Linear-Quadratic Reinforcement Learning Problems24 Jul 2024
- 2024NeoRL: Efficient Exploration for Nonepisodic RL3 Jun 2024
- 2024Near-Optimal Regret in Linear MDPs with Aggregate Bandit Feedback13 May 2024
- 2024Projection by Convolution: Optimal Sample Complexity for Reinforcement Learning in Continuous-Space MDPs10 May 2024
12 newest of 14 All 14 (JSON)
- 2025Optimistically Optimistic Exploration for Provably Efficient Infinite-Horizon Reinforcement and Imitation Learningcited by 12
- 2025IL-SOAR : Imitation Learning with Soft Optimistic Actor cRiticcited by 5
- 2026Multi-agent imitation learning with function approximation: Linear Markov games and beyondcited by 1
- 2026Multi-agent imitation learning with function approximation: Linear Markov games and beyond26 Feb 2026
- 2025IL-SOAR : Imitation Learning with Soft Optimistic Actor cRitic27 Feb 2025
- 2025Optimistically Optimistic Exploration for Provably Efficient Infinite-Horizon Reinforcement and Imitation Learning19 Feb 2025
- 2022Statistical Learning Theory for Control: A Finite Sample Perspectivecited by 53
- 2021Stabilizing Dynamical Systems via Policy Gradient Methodscited by 25
- 2021A Free Lunch from the Noise: Provable and Practical Exploration for Representation Learningcited by 24
- 2023Optimal Exploration for Model-Based RL in Nonlinear Systemscited by 18
- 2021Lazy OCO: Online Convex Optimization on a Switching Budgetcited by 14
- 2021PC-MLP: Model-based Reinforcement Learning with Policy Cover Guided Explorationcited by 14
- 2023Rate-Optimal Policy Optimization for Linear Markov Decision Processescited by 14
- 2022Online Control of Unknown Time-Varying Dynamical Systemscited by 13
- 2021Online Policy Gradient for Model Free Learning of Linear Quadratic Regulators with √T Regretcited by 12
- 2022Regret Lower Bounds for Learning Linear Quadratic Gaussian Systemscited by 11
- 2021Regret-optimal Estimation and Controlcited by 10
- 2021Sparsity in Partially Controllable Linear Systemscited by 9
12 most cited of 53 All 53 (JSON)
- 2026Block Optimism for Nonstationary Bandits with Latent Linear Dynamics1 Oct 2026
- 2026Consistent Model Chasing Is Minimax Optimal: The Exact Value of Scalar Adversarial Adaptive Control under Large Parametric Uncertainty13 Aug 2026
- 2026A Spectral Filtering Approach to Regret Analysis of Distributed Online Control for Linear Dynamical Systems3 Aug 2026
- 2026When Can Safe Controllers Adapt? Information before Commitment18 Jul 2026
- 2025Adversarially Robust Multitask Adaptive Control7 Nov 2025
- 2025Efficient Spectral Control of Partially Observed Linear Dynamical Systems27 May 2025
- 2025A New Approach to Controlling Linear Dynamical Systems4 Apr 2025
- 2025Universal Sequence Preconditioning10 Feb 2025
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2024Regret Analysis of Multi-task Representation Learning for Linear-Quadratic Adaptive Control8 Jul 2024
- 2024Learning to Stabilize Unknown LTI Systems on a Single Trajectory under Stochastic Noise31 May 2024
- 2024Model-Agnostic Zeroth-Order Policy Optimization for Meta-Learning of Ergodic Linear Quadratic Regulators27 May 2024
12 newest of 53 All 53 (JSON)