Online Control with Adversarial Disturbances
Not on the map. Why?
Abstract (arXiv)
We study the control of a linear dynamical system with adversarial disturbances (as opposed to statistical noise). The objective we consider is one of regret: we desire an online control procedure that can do nearly as well as that of a procedure that has full knowledge of the disturbances in hindsight. Our main result is an efficient algorithm that provides nearly tight regret bounds for this problem. From a technical standpoint, this work generalizes upon previous work in two main aspects: our model allows for adversarial noise in the dynamics, and allows for general convex costs.
Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 23; 2023: 18; 2024: 13; 2025: 8; 2026: 6.
92 papers.
Sort:
By area:
- 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustnesscited by 43
- 2022Provable Reinforcement Learning with a Short-Term Memorycited by 40
- 2024Online DPO: Online Direct Preference Optimization with Fast-Slow Chasingcited by 38
- 2021Non-stationary Online Learning with Memory and Non-stochastic Controlcited by 33
- 2022Model-based RL with Optimistic Posterior Sampling: Structural Conditions and Sample Complexitycited by 31
- 2022Parameter-free Regret in High Probability with Heavy Tailscited by 26
- 2021Online Learning with Simple Predictors and a Combinatorial Characterization of Minimax in 0/1 Gamescited by 18
- 2021Streaming Linear System Identification with Reverse Experience Replaycited by 17
- 2021Task-Optimal Exploration in Linear Dynamical Systemscited by 15
- 2021Learning-to-learn non-convex piecewise-Lipschitz functionscited by 15
- 2023Efficient Methods for Non-stationary Online Learningcited by 15
- 2021Adversarial Tracking Control via Strongly Adaptive Online Learning with Memorycited by 14
38 more
- 2021Lazy OCO: Online Convex Optimization on a Switching Budgetcited by 14
- 2023Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregressioncited by 14
- 2022Online Control of Unknown Time-Varying Dynamical Systemscited by 13
- 2022Dynamic Regret of Online Markov Decision Processescited by 13
- 2025Online Convex Optimization with Heavy Tails: Old Algorithms, New Regrets, and Applicationscited by 13
- 2023Sample-Efficient Linear Representation Learning from Non-IID Non-Isotropic Datacited by 12
- 2021Prospective Artificial Intelligence Approaches for Active Cyber Defencecited by 11
- 2021Deluca -- A Differentiable Control Library: Environments, Methods, and Benchmarkingcited by 10
- 2021Regret-optimal Estimation and Controlcited by 10
- 2021Safe Adaptive Learning-based Control for Constrained Linear Quadratic Regulators with Regret Guaranteescited by 10
- 2022Non-Linear Reinforcement Learning in Large Action Spaces: Structural Conditions and Sample-efficiency of Posterior Samplingcited by 10
- 2021Learning from Censored and Dependent Data: The case of Linear Dynamicscited by 9
- 2022Optimal Comparator Adaptive Online Learning with Switching Costcited by 9
- 2023Smoothed Online Learning for Prediction in Piecewise Affine Systemscited by 9
- 2021A Regret Minimization Approach to Iterative Learning Controlcited by 8
- 2021Competitive Controlcited by 8
- 2022Adversarially Robust PAC Learnability of Real-Valued Functionscited by 8
- 2023Beyond Black-Box Advice: Learning-Augmented Algorithms for MDPs with Q-Value Predictionscited by 8
- 2023Optimal Rates for Bandit Nonstochastic Controlcited by 7
- 2021Regret Analysis of Distributed Online LQR Control for Unknown LTI Systemscited by 6
- 2021Provable Regret Bounds for Deep Online Learning and Controlcited by 6
- 2022Bandits Corrupted by Nature: Lower Bounds on Regret and Robust Optimistic Algorithmcited by 6
- 2022Adaptive Composite Online Optimization: Predictions in Static and Dynamic Environmentscited by 6
- 2022Optimal Dynamic Regret in LQR Controlcited by 6
- 2022Towards a Theoretical Foundation of Policy Optimization for Learning Control Policiescited by 6
- 2022Online Convex Optimization with Unbounded Memorycited by 6
- 2025Universal Sequence Preconditioningcited by 6
- 2021Online Optimization with Feedback Delay and Nonlinear Switching Costcited by 5
- 2022Rate-Optimal Online Convex Optimization in Adaptive Linear Controlcited by 5
- 2022Meta-Learning Online Control for Linear Dynamical Systemscited by 5
- 2022Best of Both Worlds in Online Control: Competitive Ratio and Policy Regretcited by 5
- 2023Efficient Online Learning with Memory via Frank-Wolfe Optimization: Algorithms with Bounded Dynamic Regret and Applications to Controlcited by 5
- 2023Online Nonstochastic Control with Adversarial and Static Constraintscited by 5
- 2023Oracle-Efficient Smoothed Online Learning for Piecewise Continuous Decision Makingcited by 5
- 2024Predictive Linear Online Tracking for Unknown Targetscited by 5
- 2025The Sample Complexity of Online Reinforcement Learning: A Multi-model Perspectivecited by 5
- 2021Robust Online Control with Model Misspecificationcited by 4
- 2021Finite-time System Identification and Adaptive Control in Autoregressive Exogenous Systemscited by 4
50 most cited of 92 All 92 (JSON)
- 2026Block Optimism for Nonstationary Bandits with Latent Linear Dynamics1 Oct 2026
- 2026A Spectral Filtering Approach to Regret Analysis of Distributed Online Control for Linear Dynamical Systems3 Aug 2026
- 2026Self-Adaptive Learning and Model Predictive Control for Tracking Unknown Dynamics with No Regret29 Jul 2026
- 2026A Memory Efficient Unified Algorithm for Online Learning of Linear Dynamical Systems2 Jul 2026
- 2026Online Nonstochastic Prediction: Logarithmic Regret via Predictive Online Least Squares6 May 2026
- 2026Tuning the burn-in phase in training recurrent neural networks improves their performance11 Feb 2026
- 2025Online Convex Optimization with Heavy Tails: Old Algorithms, New Regrets, and Applications10 Aug 2025
- 2025Online Multi-Agent Control with Adversarial Disturbances23 Jun 2025
- 2025Efficient Spectral Control of Partially Observed Linear Dynamical Systems27 May 2025
- 2025A New Approach to Controlling Linear Dynamical Systems4 Apr 2025
- 2025Optimistic Learning for Communication Networks4 Apr 2025
- 2025Offline Reinforcement Learning via Inverse Optimization27 Feb 2025
38 more
- 2025Universal Sequence Preconditioning10 Feb 2025
- 2025The Sample Complexity of Online Reinforcement Learning: A Multi-model Perspective27 Jan 2025
- 2024Online Convex Optimization with Memory and Limited Predictions31 Oct 2024
- 2024Tight Rates for Bandit Control Beyond Quadratics1 Oct 2024
- 2024Safe Online Convex Optimization with Multi-Point Feedback16 Jul 2024
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2024Online Stackelberg Optimization via Nonlinear Control27 Jun 2024
- 2024Online DPO: Online Direct Preference Optimization with Fast-Slow Chasing8 Jun 2024
- 2024Online Control in Population Dynamics3 Jun 2024
- 2024Future Aware Safe Active Learning of Time Varying Systems using Gaussian Processes17 May 2024
- 2024Optimistic Online Non-stochastic Control via FTRL4 Apr 2024
- 2024Regret Analysis of Policy Optimization over Submanifolds for Linearly Constrained Online LQG13 Mar 2024
- 2024Online Control of Linear Systems under Unbounded Noise15 Feb 2024
- 2024Predictive Linear Online Tracking for Unknown Targets15 Feb 2024
- 2024The Complexity of Sequential Prediction in Dynamical Systems9 Feb 2024
- 2023Online Decision Making with History-Average Dependent Costs (Extended)11 Dec 2023
- 2023Controlgym: Large-Scale Control Environments for Benchmarking Reinforcement Learning Algorithms30 Nov 2023
- 2023Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression17 Oct 2023
- 2023Regret Analysis of Distributed Online Control for LTI Systems with Adversarial Disturbances4 Oct 2023
- 2023Adaptive Online Non-stochastic Control2 Oct 2023
- 2023Efficient Methods for Non-stationary Online Learning16 Sep 2023
- 2023Data-Driven Adversarial Online Control for Unknown Linear Systems16 Aug 2023
- 2023Sample-Efficient Linear Representation Learning from Non-IID Non-Isotropic Data8 Aug 2023
- 2023Beyond Black-Box Advice: Learning-Augmented Algorithms for MDPs with Q-Value Predictions20 Jul 2023
- 2023Online Nonstochastic Model-Free Reinforcement Learning27 May 2023
- 2023Optimal Rates for Bandit Nonstochastic Control24 May 2023
- 2023Learning to Seek: Multi-Agent Online Source Seeking Against Non-Stochastic Disturbances29 Apr 2023
- 2023Oracle-Efficient Smoothed Online Learning for Piecewise Continuous Decision Making10 Feb 2023
- 2023Online Nonstochastic Control with Adversarial and Static Constraints5 Feb 2023
- 2023Smoothed Online Learning for Prediction in Piecewise Affine Systems26 Jan 2023
- 2023A Nonstochastic Control Approach to Optimization19 Jan 2023
- 2023Approximate Information States for Worst-Case Control and Learning in Uncertain Systems12 Jan 2023
- 2023Efficient Online Learning with Memory via Frank-Wolfe Optimization: Algorithms with Bounded Dynamic Regret and Applications to Control2 Jan 2023
- 2022Best of Both Worlds in Online Control: Competitive Ratio and Policy Regret21 Nov 2022
- 2022Parameter-free Regret in High Probability with Heavy Tails25 Oct 2022
- 2022Online Convex Optimization with Unbounded Memory18 Oct 2022
- 2022Learning Decentralized Linear Quadratic Regulators with √T Regret17 Oct 2022
- 2022Towards a Theoretical Foundation of Policy Optimization for Learning Control Policies10 Oct 2022
50 newest of 92 All 92 (JSON)
- 2025Offline Reinforcement Learning via Inverse Optimizationcited by 2
- 2025Offline Reinforcement Learning via Inverse Optimization27 Feb 2025
- 2021Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustnesscited by 43
- 2022Provable Reinforcement Learning with a Short-Term Memorycited by 40
- 2021Non-stationary Online Learning with Memory and Non-stochastic Controlcited by 33
- 2022Model-based RL with Optimistic Posterior Sampling: Structural Conditions and Sample Complexitycited by 31
- 2022Parameter-free Regret in High Probability with Heavy Tailscited by 26
- 2021Online Learning with Simple Predictors and a Combinatorial Characterization of Minimax in 0/1 Gamescited by 18
- 2021Streaming Linear System Identification with Reverse Experience Replaycited by 17
- 2021Task-Optimal Exploration in Linear Dynamical Systemscited by 15
- 2021Learning-to-learn non-convex piecewise-Lipschitz functionscited by 15
- 2023Efficient Methods for Non-stationary Online Learningcited by 15
- 2021Adversarial Tracking Control via Strongly Adaptive Online Learning with Memorycited by 14
- 2021Lazy OCO: Online Convex Optimization on a Switching Budgetcited by 14
12 most cited of 90 All 90 (JSON)
- 2026Block Optimism for Nonstationary Bandits with Latent Linear Dynamics1 Oct 2026
- 2026A Spectral Filtering Approach to Regret Analysis of Distributed Online Control for Linear Dynamical Systems3 Aug 2026
- 2026Self-Adaptive Learning and Model Predictive Control for Tracking Unknown Dynamics with No Regret29 Jul 2026
- 2026A Memory Efficient Unified Algorithm for Online Learning of Linear Dynamical Systems2 Jul 2026
- 2026Online Nonstochastic Prediction: Logarithmic Regret via Predictive Online Least Squares6 May 2026
- 2026Tuning the burn-in phase in training recurrent neural networks improves their performance11 Feb 2026
- 2025Online Convex Optimization with Heavy Tails: Old Algorithms, New Regrets, and Applications10 Aug 2025
- 2025Online Multi-Agent Control with Adversarial Disturbances23 Jun 2025
- 2025Efficient Spectral Control of Partially Observed Linear Dynamical Systems27 May 2025
- 2025A New Approach to Controlling Linear Dynamical Systems4 Apr 2025
- 2025Optimistic Learning for Communication Networks4 Apr 2025
- 2025Universal Sequence Preconditioning10 Feb 2025
12 newest of 90 All 90 (JSON)