mlsanityData to 14 Oct 2026

Logarithmic Regret from Sublinear Hints

arXiv 2111.05257 ↗First posted 9 Nov 2021cs.LG cs.DS stat.MLcited by 12

Not on the map. Why?

Abstract (arXiv)

We consider the online linear optimization problem, where at every step the algorithm plays a point xt in the unit ball, and suffers loss langle ct, xtrangle for some cost vector ct that is then revealed to the algorithm. Recent work showed that if an algorithm receives a hint ht that has non-trivial correlation with ct before it plays xt, then it can achieve a regret guarantee of O(log T), improving on the bound of Theta(√T) in the standard setting. In this work, we study the question of whether an algorithm really requires a hint at every time step. Somewhat surprisingly, we show that an algorithm can obtain O(log T) regret with just O(√T) hints under a natural query model; in contrast, we also show that o(√T) hints cannot guarantee better than Omega(√T) regret. We give two applications of our result, to the well-studied setting of optimistic regret bounds and to the problem of online learning with abstention.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 9 Nov 2021.

Builds on

16 of 29 references.

References · 16

  1. 2018Competitive caching with machine learned advicecited by 195
  2. 2018Black-Box Reductions for Parameter-free Online Learning in Banach Spacescited by 125
  3. 2018More Adaptive Algorithms for Adversarial Banditscited by 114
  4. 2019Near-Optimal Bounds for Online Caching with Machine Learned Advicecited by 73
  5. 2020Lipschitz and Comparator-Norm Adaptivity in Online Learningcited by 57
  6. 2021Impossible Tuning Made Possible: A New Expert Algorithm and Its Applicationscited by 52
  7. 2019Scheduling with Predictions and the Price of Mispredictioncited by 47
  8. 2020Learning Augmented Energy Minimization via Speed Scalingcited by 38
  9. 2020Online Learning with Imperfect Hintscited by 37
  10. 2020Online Algorithms for Weighted Paging with Predictionscited by 29
  11. 2020Learnable and Instance-Robust Predictions for Online Matching, Flows and Load Balancingcited by 27
  12. 2019Improved Path-length Regret Bounds for Banditscited by 23
4 more
  1. 2019Adaptive scale-invariant online algorithms for learning linear modelscited by 19
  2. 2020Fast Rates for Online Prediction with Abstentioncited by 19
  3. 2020Online Linear Optimization with Many Hintscited by 16
  4. 2018Semi-Online Bipartite Matchingcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 1; 2024: 3; 2025: 1; 2026: 5.

12 papers.