Logarithmic Regret for Adversarial Online Control
Not on the map. Why?
Abstract (arXiv)
We introduce a new algorithm for online linear-quadratic control in a known system subject to adversarial disturbances. Existing regret bounds for this setting scale as √T unless strong stochastic assumptions are imposed on the disturbance process. We give the first algorithm with logarithmic regret for arbitrary adversarial disturbance sequences, provided the state and control costs are given by known quadratic functions. Our algorithm and analysis use a characterization for the optimal offline control law to reduce the online control problem to (delayed) online learning with approximate advantage functions. Compared to previous techniques, our approach does not need to control movement costs for the iterates, leading to logarithmic regret.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 10; 2023: 8; 2024: 7; 2025: 6; 2026: 4.
41 papers.
Sort:
By area:
- 2021Non-stationary Online Learning with Memory and Non-stochastic Controlcited by 33
- 2023Efficient Methods for Non-stationary Online Learningcited by 15
- 2021Adversarial Tracking Control via Strongly Adaptive Online Learning with Memorycited by 14
- 2021Lazy OCO: Online Convex Optimization on a Switching Budgetcited by 14
- 2021Regret-optimal Estimation and Controlcited by 10
- 2022Exploiting the Curvature of Feasible Sets for Faster Projection-Free Online Learningcited by 10
- 2021Competitive Controlcited by 8
- 2023Optimal Rates for Bandit Nonstochastic Controlcited by 7
- 2022Optimal Dynamic Regret in LQR Controlcited by 6
- 2022Model Predictive Control via On-Policy Imitation Learningcited by 6
- 2022Online Convex Optimization with Unbounded Memorycited by 6
- 2022Best of Both Worlds in Online Control: Competitive Ratio and Policy Regretcited by 5
29 more
- 2023Online Nonstochastic Control with Adversarial and Static Constraintscited by 5
- 2024Predictive Linear Online Tracking for Unknown Targetscited by 5
- 2022Efficient Online Linear Control with Stochastic Convex Costs and Unknown Dynamicscited by 4
- 2023PAC-Bayesian bounds for learning LTI-ss systems with input from empirical losscited by 3
- 2023Adaptive Online Non-stochastic Controlcited by 3
- 2024Optimistic Online Non-stochastic Control via FTRLcited by 3
- 2022Optimal Competitive-Ratio Controlcited by 2
- 2024Length independent generalization bounds for deep SSM architectures via Rademacher contraction and stability constraintscited by 2
- 2024Incremental Online Learning of Randomized Neural Network with Forward Regularizationcited by 2
- 2025Offline Reinforcement Learning via Inverse Optimizationcited by 2
- 2025A New Approach to Controlling Linear Dynamical Systemscited by 2
- 2025A Simple, Optimal and Efficient Algorithm for Online Exp-Concave Optimizationcited by 2
- 2026Parameter-free Dynamic Regret: Time-varying Movement Costs, Delayed Feedback, and Memorycited by 2
- 2022PAC-Bayesian-Like Error Bound for a Class of Linear Time-Invariant Stochastic State-Space Modelscited by 1
- 2024Online Residual Learning from Offline Experts for Pedestrian Trackingcited by 1
- 2021Regret-Optimal LQR Controlcited by 0
- 2022Rate-matching the regret lower-bound in the linear quadratic regulator with unknown dynamicscited by 0
- 2022Learning to Control under Time-Varying Environmentcited by 0
- 2023Learning to Seek: Multi-Agent Online Source Seeking Against Non-Stochastic Disturbancescited by 0
- 2023PAC bounds of continuous Linear Parameter-Varying systems related to neural ODEscited by 0
- 2023Data-Driven Adversarial Online Control for Unknown Linear Systemscited by 0
- 2024Online Control of Linear Systems under Unbounded Noisecited by 0
- 2024A finite-sample generalization bound for stable LPV systemscited by 0
- 2025Efficient Spectral Control of Partially Observed Linear Dynamical Systemscited by 0
- 2025Online Multi-Agent Control with Adversarial Disturbancescited by 0
- 2025Smoothed Online Optimization for Target Tracking: Robust and Learning-Augmented Algorithmscited by 0
- 2026Online Nonstochastic Prediction: Logarithmic Regret via Predictive Online Least Squarescited by 0
- 2026A Memory Efficient Unified Algorithm for Online Learning of Linear Dynamical Systemscited by 0
- 2026Self-Adaptive Learning and Model Predictive Control for Tracking Unknown Dynamics with No Regretcited by 0
- 2026Self-Adaptive Learning and Model Predictive Control for Tracking Unknown Dynamics with No Regret29 Jul 2026
- 2026A Memory Efficient Unified Algorithm for Online Learning of Linear Dynamical Systems2 Jul 2026
- 2026Online Nonstochastic Prediction: Logarithmic Regret via Predictive Online Least Squares6 May 2026
- 2026Parameter-free Dynamic Regret: Time-varying Movement Costs, Delayed Feedback, and Memory6 Feb 2026
- 2025A Simple, Optimal and Efficient Algorithm for Online Exp-Concave Optimization29 Dec 2025
- 2025Smoothed Online Optimization for Target Tracking: Robust and Learning-Augmented Algorithms7 Sep 2025
- 2025Online Multi-Agent Control with Adversarial Disturbances23 Jun 2025
- 2025Efficient Spectral Control of Partially Observed Linear Dynamical Systems27 May 2025
- 2025A New Approach to Controlling Linear Dynamical Systems4 Apr 2025
- 2025Offline Reinforcement Learning via Inverse Optimization27 Feb 2025
- 2024Incremental Online Learning of Randomized Neural Network with Forward Regularization17 Dec 2024
- 2024Online Residual Learning from Offline Experts for Pedestrian Tracking6 Sep 2024
29 more
- 2024Length independent generalization bounds for deep SSM architectures via Rademacher contraction and stability constraints30 May 2024
- 2024A finite-sample generalization bound for stable LPV systems16 May 2024
- 2024Optimistic Online Non-stochastic Control via FTRL4 Apr 2024
- 2024Online Control of Linear Systems under Unbounded Noise15 Feb 2024
- 2024Predictive Linear Online Tracking for Unknown Targets15 Feb 2024
- 2023Adaptive Online Non-stochastic Control2 Oct 2023
- 2023Efficient Methods for Non-stationary Online Learning16 Sep 2023
- 2023Data-Driven Adversarial Online Control for Unknown Linear Systems16 Aug 2023
- 2023PAC bounds of continuous Linear Parameter-Varying systems related to neural ODEs7 Jul 2023
- 2023Optimal Rates for Bandit Nonstochastic Control24 May 2023
- 2023Learning to Seek: Multi-Agent Online Source Seeking Against Non-Stochastic Disturbances29 Apr 2023
- 2023PAC-Bayesian bounds for learning LTI-ss systems with input from empirical loss29 Mar 2023
- 2023Online Nonstochastic Control with Adversarial and Static Constraints5 Feb 2023
- 2022PAC-Bayesian-Like Error Bound for a Class of Linear Time-Invariant Stochastic State-Space Models30 Dec 2022
- 2022Best of Both Worlds in Online Control: Competitive Ratio and Policy Regret21 Nov 2022
- 2022Online Convex Optimization with Unbounded Memory18 Oct 2022
- 2022Model Predictive Control via On-Policy Imitation Learning17 Oct 2022
- 2022Optimal Dynamic Regret in LQR Control18 Jun 2022
- 2022Learning to Control under Time-Varying Environment6 Jun 2022
- 2022Optimal Competitive-Ratio Control3 Jun 2022
- 2022Exploiting the Curvature of Feasible Sets for Faster Projection-Free Online Learning23 May 2022
- 2022Efficient Online Linear Control with Stochastic Convex Costs and Unknown Dynamics2 Mar 2022
- 2022Rate-matching the regret lower-bound in the linear quadratic regulator with unknown dynamics11 Feb 2022
- 2021Competitive Control28 Jul 2021
- 2021Regret-optimal Estimation and Control22 Jun 2021
- 2021Regret-Optimal LQR Control4 May 2021
- 2021Lazy OCO: Online Convex Optimization on a Switching Budget7 Feb 2021
- 2021Non-stationary Online Learning with Memory and Non-stochastic Control7 Feb 2021
- 2021Adversarial Tracking Control via Strongly Adaptive Online Learning with Memory2 Feb 2021
- 2022Model Predictive Control via On-Policy Imitation Learningcited by 6
- 2025Offline Reinforcement Learning via Inverse Optimizationcited by 2
- 2025Offline Reinforcement Learning via Inverse Optimization27 Feb 2025
- 2022Model Predictive Control via On-Policy Imitation Learning17 Oct 2022
- 2021Non-stationary Online Learning with Memory and Non-stochastic Controlcited by 33
- 2023Efficient Methods for Non-stationary Online Learningcited by 15
- 2021Adversarial Tracking Control via Strongly Adaptive Online Learning with Memorycited by 14
- 2021Lazy OCO: Online Convex Optimization on a Switching Budgetcited by 14
- 2021Regret-optimal Estimation and Controlcited by 10
- 2022Exploiting the Curvature of Feasible Sets for Faster Projection-Free Online Learningcited by 10
- 2021Competitive Controlcited by 8
- 2023Optimal Rates for Bandit Nonstochastic Controlcited by 7
- 2022Optimal Dynamic Regret in LQR Controlcited by 6
- 2022Online Convex Optimization with Unbounded Memorycited by 6
- 2022Best of Both Worlds in Online Control: Competitive Ratio and Policy Regretcited by 5
- 2023Online Nonstochastic Control with Adversarial and Static Constraintscited by 5
12 most cited of 39 All 39 (JSON)
- 2026Self-Adaptive Learning and Model Predictive Control for Tracking Unknown Dynamics with No Regret29 Jul 2026
- 2026A Memory Efficient Unified Algorithm for Online Learning of Linear Dynamical Systems2 Jul 2026
- 2026Online Nonstochastic Prediction: Logarithmic Regret via Predictive Online Least Squares6 May 2026
- 2026Parameter-free Dynamic Regret: Time-varying Movement Costs, Delayed Feedback, and Memory6 Feb 2026
- 2025A Simple, Optimal and Efficient Algorithm for Online Exp-Concave Optimization29 Dec 2025
- 2025Smoothed Online Optimization for Target Tracking: Robust and Learning-Augmented Algorithms7 Sep 2025
- 2025Online Multi-Agent Control with Adversarial Disturbances23 Jun 2025
- 2025Efficient Spectral Control of Partially Observed Linear Dynamical Systems27 May 2025
- 2025A New Approach to Controlling Linear Dynamical Systems4 Apr 2025
- 2024Incremental Online Learning of Randomized Neural Network with Forward Regularization17 Dec 2024
- 2024Online Residual Learning from Offline Experts for Pedestrian Tracking6 Sep 2024
- 2024Length independent generalization bounds for deep SSM architectures via Rademacher contraction and stability constraints30 May 2024
12 newest of 39 All 39 (JSON)