Robust Learning for Smoothed Online Convex Optimization with Feedback Delay
Not on the map. Why?
Abstract (arXiv)
We study a challenging form of Smoothed Online Convex Optimization, a.k.a. SOCO, including multi-step nonlinear switching costs and feedback delay. We propose a novel machine learning (ML) augmented online algorithm, Robustness-Constrained Learning (RCL), which combines untrusted ML predictions with a trusted expert online algorithm via constrained projection to robustify the ML prediction. Specifically,we prove that RCL is able to guarantee(1+λ)-competitiveness against any given expert for anyλ>0, while also explicitly training the ML model in a robustification-aware manner to improve the average-case performance. Importantly,RCL is the first ML-augmented algorithm with a provable robustness guarantee in the case of multi-step switching cost and feedback delay.We demonstrate the improvement of RCL in both robustness and average performance using battery management for electrifying transportationas a case study.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 34 of its 56 references that are in the map. First posted on arXiv 31 Oct 2023.
Builds on
34 of 56 references.
References · 34
- 2021Convex optimizationcited by 2,515
- 2017Spectrally-normalized margin bounds for neural networkscited by 686
- 2019Differentiable Convex Optimization Layerscited by 465
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 208
- 2020Projection-Based Constrained Policy Optimizationcited by 203
- 2018Competitive caching with machine learned advicecited by 195
- 2022Do Differentiable Simulators Give Better Policy Gradients?cited by 89
- 2018Neural Lander: Stable Drone Landing Control using Learned Dynamicscited by 85
- 2021Conservative Offline Distributional Reinforcement Learningcited by 79
- 2020Online metric algorithms with untrusted predictionscited by 75
- 2020Optimal Robustness-Consistency Trade-offs for Learning-Augmented Online Algorithmscited by 64
- 2019Online Optimal Control with Linear Dynamics and Predictions: Algorithms and Regret Analysiscited by 40
22 more
- 2018Smoothed Online Convex Optimization in High Dimensions via Online Balanced Descentcited by 33
- 2019Beyond Online Balanced Descent: An Optimal Algorithm for Smoothed Online Optimizationcited by 31
- 2021Revisiting Smoothed Online Learningcited by 29
- 2018Online Optimization with Predictions and Switching Costs: Fast Algorithms and the Fundamental Limitcited by 27
- 2022Memory Bounds for the Experts Problemcited by 20
- 2022Chasing Convex Bodies and Functions with Black-Box Advicecited by 19
- 2021Robustness and Consistency in Linear Quadratic Control with Untrusted Predictionscited by 14
- 2019Online Optimization with Predictions and Non-convex Lossescited by 12
- 2021Robust Learning-Augmented Caching: An Experimental Studycited by 12
- 2022A Regression Approach to Learning-Augmented Online Algorithmscited by 12
- 2017Online Learning with Local Permutations and Delayed Feedbackcited by 10
- 2021Deep Policies for Online Bipartite Matching: A Reinforcement Learning Approachcited by 10
- 2022Smoothed Online Optimization with Unreliable Predictionscited by 10
- 2021A Reduction-Based Framework for Conservative Bandits and Reinforcement Learningcited by 9
- 2021Adversarial Deep Learning for Online Resource Allocationcited by 7
- 2020Learning Robust Algorithms for Online Allocation Problems Using Adversarial Trainingcited by 6
- 2022Expert-Calibrated Learning for Online Optimization with Switching Costscited by 6
- 2022Equipping Black-Box Policies with Model-Based Advice for Stable Nonlinear Controlcited by 6
- 2021Online Optimization with Feedback Delay and Nonlinear Switching Costcited by 5
- 2023Robustified Learning for Online Optimization with Memory Costscited by 4
- 2013Online Coordinated Charging Decision Algorithm for Electric Vehicles without Future Informationcited by 3
- 2021Online Capacity Scaling Augmented With Unreliable Machine Learning Predictionscited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.
- 2024Online Budgeted Matching with General Bidscited by 0
- 2024Safe Exploitative Play with Untrusted Type Beliefscited by 0
- 2025Fairness-Regularized Online Optimization with Switching Costscited by 0
- 2025Fairness-Regularized Online Optimization with Switching Costs11 Dec 2025
- 2024Safe Exploitative Play with Untrusted Type Beliefs12 Nov 2024
- 2024Online Budgeted Matching with General Bids6 Nov 2024