The Power of Predictions in Online Control
Not on the map. Why?
Abstract (arXiv)
We study the impact of predictions in online Linear Quadratic Regulator control with both stochastic and adversarial disturbances in the dynamics. In both settings, we characterize the optimal policy and derive tight bounds on the minimum cost and dynamic regret. Perhaps surprisingly, our analysis shows that the conventional greedy MPC approach is a near-optimal policy in both stochastic and adversarial settings. Specifically, for length-T problems, MPC requires only O(log T) predictions to reach O(1) dynamic regret, which matches (up to lower-order terms) our lower bound on the required prediction horizon for constant regret.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 6; 2023: 8; 2024: 6; 2025: 1; 2026: 5.
31 papers.
Sort:
By area:
- 2021Meta-Adaptive Nonlinear Control: Theory and Algorithmscited by 23
- 2023Optimal Exploration for Model-Based RL in Nonlinear Systemscited by 17
- 2021Adversarial Tracking Control via Strongly Adaptive Online Learning with Memorycited by 14
- 2023DATT: Deep Adaptive Trajectory Tracking for Quadrotor Controlcited by 11
- 2024Reinforcement Learning with Lookahead Informationcited by 8
- 2023Deep Model Predictive Optimizationcited by 7
- 2021Regret Analysis of Distributed Online LQR Control for Unknown LTI Systemscited by 6
- 2022Adaptive Composite Online Optimization: Predictions in Static and Dynamic Environmentscited by 6
- 2021Online Optimization with Feedback Delay and Nonlinear Switching Costcited by 5
- 2024Predictive Linear Online Tracking for Unknown Targetscited by 5
- 2021Online Learning for Predictive Control with Provable Regret Guaranteescited by 3
- 2022Implications of Regret on Stability of Linear Dynamical Systemscited by 3
19 more
- 2023Adaptive Online Non-stochastic Controlcited by 3
- 2024CoVO-MPC: Theoretical Analysis of Sampling-based MPC and Optimal Covariance Designcited by 3
- 2024Optimistic Online Non-stochastic Control via FTRLcited by 3
- 2025Reinforcement Learning with Imperfect Transition Predictions: A Bellman-Jensen Approachcited by 3
- 2026AdaReP:Adaptive Re-Planning under Model Mismatch for Neural World-Model Predictive Controlcited by 3
- 2022Neural-Rendezvous: Provably Robust Guidance and Control to Encounter Interstellar Objectscited by 2
- 2024Predictive Control and Regret Analysis of Non-Stationary MDP with Look-ahead Informationcited by 2
- 2022Interstellar Object Accessibility and Mission Designcited by 1
- 2022A Critical Review of Traffic Signal Control and A Novel Unified View of Reinforcement Learning and Model Predictive Control Approaches for Adaptive Traffic Signal Controlcited by 1
- 2023Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based controlcited by 1
- 2023Regret Analysis of Distributed Online Control for LTI Systems with Adversarial Disturbancescited by 1
- 2024Preparing for Black Swans: The Antifragility Imperative for Machine Learningcited by 1
- 2022Bayesian Learning Approach to Model Predictive Controlcited by 0
- 2023Sub-linear Regret in Adaptive Model Predictive Controlcited by 0
- 2023Data-Guided Regulator for Adaptive Nonlinear Controlcited by 0
- 2026Reinforcement Learning with Multi-Step Lookahead Information Via Adaptive Batchingcited by 0
- 2026Constrained Online Convex Optimization with Memory and Predictionscited by 0
- 2026Learning to Spend: Model Predictive Control for Budgeting under Non-Stationary Returnscited by 0
- 2026A Spectral Filtering Approach to Regret Analysis of Distributed Online Control for Linear Dynamical Systemscited by 0
- 2026A Spectral Filtering Approach to Regret Analysis of Distributed Online Control for Linear Dynamical Systems3 Aug 2026
- 2026AdaReP:Adaptive Re-Planning under Model Mismatch for Neural World-Model Predictive Control22 Jun 2026
- 2026Learning to Spend: Model Predictive Control for Budgeting under Non-Stationary Returns29 Apr 2026
- 2026Constrained Online Convex Optimization with Memory and Predictions22 Mar 2026
- 2026Reinforcement Learning with Multi-Step Lookahead Information Via Adaptive Batching15 Jan 2026
- 2025Reinforcement Learning with Imperfect Transition Predictions: A Bellman-Jensen Approach21 Oct 2025
- 2024Predictive Control and Regret Analysis of Non-Stationary MDP with Look-ahead Information13 Sep 2024
- 2024Reinforcement Learning with Lookahead Information4 Jun 2024
- 2024Preparing for Black Swans: The Antifragility Imperative for Machine Learning18 May 2024
- 2024Optimistic Online Non-stochastic Control via FTRL4 Apr 2024
- 2024Predictive Linear Online Tracking for Unknown Targets15 Feb 2024
- 2024CoVO-MPC: Theoretical Analysis of Sampling-based MPC and Optimal Covariance Design14 Jan 2024
19 more
- 2023Data-Guided Regulator for Adaptive Nonlinear Control20 Nov 2023
- 2023DATT: Deep Adaptive Trajectory Tracking for Quadrotor Control13 Oct 2023
- 2023Sub-linear Regret in Adaptive Model Predictive Control7 Oct 2023
- 2023Deep Model Predictive Optimization6 Oct 2023
- 2023Regret Analysis of Distributed Online Control for LTI Systems with Adversarial Disturbances4 Oct 2023
- 2023Adaptive Online Non-stochastic Control2 Oct 2023
- 2023Optimal Exploration for Model-Based RL in Nonlinear Systems15 Jun 2023
- 2023Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based control19 Jan 2023
- 2022A Critical Review of Traffic Signal Control and A Novel Unified View of Reinforcement Learning and Model Predictive Control Approaches for Adaptive Traffic Signal Control26 Nov 2022
- 2022Implications of Regret on Stability of Linear Dynamical Systems14 Nov 2022
- 2022Interstellar Object Accessibility and Mission Design26 Oct 2022
- 2022Neural-Rendezvous: Provably Robust Guidance and Control to Encounter Interstellar Objects9 Aug 2022
- 2022Adaptive Composite Online Optimization: Predictions in Static and Dynamic Environments1 May 2022
- 2022Bayesian Learning Approach to Model Predictive Control5 Mar 2022
- 2021Online Learning for Predictive Control with Provable Regret Guarantees30 Nov 2021
- 2021Online Optimization with Feedback Delay and Nonlinear Switching Cost29 Oct 2021
- 2021Meta-Adaptive Nonlinear Control: Theory and Algorithms11 Jun 2021
- 2021Regret Analysis of Distributed Online LQR Control for Unknown LTI Systems15 May 2021
- 2021Adversarial Tracking Control via Strongly Adaptive Online Learning with Memory2 Feb 2021
- 2021Meta-Adaptive Nonlinear Control: Theory and Algorithmscited by 23
- 2023Optimal Exploration for Model-Based RL in Nonlinear Systemscited by 17
- 2021Adversarial Tracking Control via Strongly Adaptive Online Learning with Memorycited by 14
- 2023DATT: Deep Adaptive Trajectory Tracking for Quadrotor Controlcited by 11
- 2024Reinforcement Learning with Lookahead Informationcited by 8
- 2023Deep Model Predictive Optimizationcited by 7
- 2021Regret Analysis of Distributed Online LQR Control for Unknown LTI Systemscited by 6
- 2022Adaptive Composite Online Optimization: Predictions in Static and Dynamic Environmentscited by 6
- 2021Online Optimization with Feedback Delay and Nonlinear Switching Costcited by 5
- 2024Predictive Linear Online Tracking for Unknown Targetscited by 5
- 2021Online Learning for Predictive Control with Provable Regret Guaranteescited by 3
- 2022Implications of Regret on Stability of Linear Dynamical Systemscited by 3
12 most cited of 30 All 30 (JSON)
- 2026A Spectral Filtering Approach to Regret Analysis of Distributed Online Control for Linear Dynamical Systems3 Aug 2026
- 2026Learning to Spend: Model Predictive Control for Budgeting under Non-Stationary Returns29 Apr 2026
- 2026Constrained Online Convex Optimization with Memory and Predictions22 Mar 2026
- 2026Reinforcement Learning with Multi-Step Lookahead Information Via Adaptive Batching15 Jan 2026
- 2025Reinforcement Learning with Imperfect Transition Predictions: A Bellman-Jensen Approach21 Oct 2025
- 2024Predictive Control and Regret Analysis of Non-Stationary MDP with Look-ahead Information13 Sep 2024
- 2024Reinforcement Learning with Lookahead Information4 Jun 2024
- 2024Preparing for Black Swans: The Antifragility Imperative for Machine Learning18 May 2024
- 2024Optimistic Online Non-stochastic Control via FTRL4 Apr 2024
- 2024Predictive Linear Online Tracking for Unknown Targets15 Feb 2024
- 2024CoVO-MPC: Theoretical Analysis of Sampling-based MPC and Optimal Covariance Design14 Jan 2024
- 2023Data-Guided Regulator for Adaptive Nonlinear Control20 Nov 2023
12 newest of 30 All 30 (JSON)