Sample Complexity of Linear Quadratic Gaussian (LQG) Control for Output Feedback Systems
Not on the map. Why?
Abstract (arXiv)
This paper studies a class of partially observed Linear Quadratic Gaussian (LQG) problems with unknown dynamics. We establish an end-to-end sample complexity bound on learning a robust LQG controller for open-loop stable plants. This is achieved using a robust synthesis procedure, where we first estimate a model from a single input-output trajectory of finite length, identify an H-infinity bound on the estimation error, and then design a robust controller using the estimated model and its quantified uncertainty. Our synthesis procedure leverages a recent control tool called Input-Output Parameterization (IOP) that enables robust controller design using convex optimization. For open-loop stable systems, we prove that the LQG performance degrades linearly with respect to the model estimation error using the proposed synthesis procedure. Despite the hidden states in the LQG problem, the achieved scaling matches previous results on learning Linear Quadratic Regulator (LQR) controllers with full state observations.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 6; 2023: 4; 2024: 2.
15 papers.
Sort:
- 2021Derivative-Free Policy Optimization for Linear Risk-Sensitive and Robust Control Design: Implicit Regularization and Sample Complexitycited by 15
- 2022Learning Mixtures of Linear Dynamical Systemscited by 15
- 2022Provable Sim-to-real Transfer in Continuous Domain with Partial Observationscited by 9
- 2021On the Sample Complexity of Decentralized Linear Quadratic Regulator with Partially Nested Information Structurecited by 7
- 2024Learning to Boost the Performance of Stable Nonlinear Systemscited by 7
- 2022How are policy gradient methods affected by the limits of control?cited by 6
- 2021Strong Consistency and Rate of Convergence of Switched Least Squares System Identification for Autonomous Markov Jump Linear Systemscited by 4
- 2023Optimization Landscape of Policy Gradient Methods for Discrete-time Static Output Feedbackcited by 2
- 2024Combining Federated Learning and Control: A Surveycited by 2
- 2022Robust Data-Driven Output Feedback Control via Bootstrapped Multiplicative Noisecited by 1
- 2022Learning Decentralized Linear Quadratic Regulators with √T Regretcited by 1
- 2023Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based controlcited by 1
3 more
- 2023On the Hardness of Learning to Stabilize Linear Systemscited by 1
- 2022Efficient Reinforcement Learning Through Trajectory Generationcited by 0
- 2023Policy Evaluation in Distributional LQRcited by 0
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2024Learning to Boost the Performance of Stable Nonlinear Systems1 May 2024
- 2023On the Hardness of Learning to Stabilize Linear Systems18 Nov 2023
- 2023Optimization Landscape of Policy Gradient Methods for Discrete-time Static Output Feedback29 Oct 2023
- 2023Policy Evaluation in Distributional LQR23 Mar 2023
- 2023Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based control19 Jan 2023
- 2022Efficient Reinforcement Learning Through Trajectory Generation30 Nov 2022
- 2022Provable Sim-to-real Transfer in Continuous Domain with Partial Observations27 Oct 2022
- 2022Learning Decentralized Linear Quadratic Regulators with √T Regret17 Oct 2022
- 2022How are policy gradient methods affected by the limits of control?14 Jun 2022
- 2022Robust Data-Driven Output Feedback Control via Bootstrapped Multiplicative Noise10 May 2022
- 2022Learning Mixtures of Linear Dynamical Systems26 Jan 2022
3 more
- 2021Strong Consistency and Rate of Convergence of Switched Least Squares System Identification for Autonomous Markov Jump Linear Systems20 Dec 2021
- 2021On the Sample Complexity of Decentralized Linear Quadratic Regulator with Partially Nested Information Structure14 Oct 2021
- 2021Derivative-Free Policy Optimization for Linear Risk-Sensitive and Robust Control Design: Implicit Regularization and Sample Complexity4 Jan 2021
- 2021Derivative-Free Policy Optimization for Linear Risk-Sensitive and Robust Control Design: Implicit Regularization and Sample Complexitycited by 15
- 2022Learning Mixtures of Linear Dynamical Systemscited by 15
- 2022Provable Sim-to-real Transfer in Continuous Domain with Partial Observationscited by 9
- 2021On the Sample Complexity of Decentralized Linear Quadratic Regulator with Partially Nested Information Structurecited by 7
- 2024Learning to Boost the Performance of Stable Nonlinear Systemscited by 7
- 2022How are policy gradient methods affected by the limits of control?cited by 6
- 2021Strong Consistency and Rate of Convergence of Switched Least Squares System Identification for Autonomous Markov Jump Linear Systemscited by 4
- 2023Optimization Landscape of Policy Gradient Methods for Discrete-time Static Output Feedbackcited by 2
- 2024Combining Federated Learning and Control: A Surveycited by 2
- 2022Robust Data-Driven Output Feedback Control via Bootstrapped Multiplicative Noisecited by 1
- 2022Learning Decentralized Linear Quadratic Regulators with √T Regretcited by 1
- 2023Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based controlcited by 1
12 most cited of 15 All 15 (JSON)
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2024Learning to Boost the Performance of Stable Nonlinear Systems1 May 2024
- 2023On the Hardness of Learning to Stabilize Linear Systems18 Nov 2023
- 2023Optimization Landscape of Policy Gradient Methods for Discrete-time Static Output Feedback29 Oct 2023
- 2023Policy Evaluation in Distributional LQR23 Mar 2023
- 2023Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based control19 Jan 2023
- 2022Efficient Reinforcement Learning Through Trajectory Generation30 Nov 2022
- 2022Provable Sim-to-real Transfer in Continuous Domain with Partial Observations27 Oct 2022
- 2022Learning Decentralized Linear Quadratic Regulators with √T Regret17 Oct 2022
- 2022How are policy gradient methods affected by the limits of control?14 Jun 2022
- 2022Robust Data-Driven Output Feedback Control via Bootstrapped Multiplicative Noise10 May 2022
- 2022Learning Mixtures of Linear Dynamical Systems26 Jan 2022
12 newest of 15 All 15 (JSON)