mlsanityData to 14 Oct 2026

Dimension-Optimal Dynamic Regret in Exp-Concave Online Learning

arXiv 2610.20187 ↗First posted 14 Oct 2026cs.LG math.OCcited by 0

Not on the map. Why?

Abstract (arXiv)

Tracking changing comparators is a central problem in online learning. For exp-concave losses, previous work established the T1/3PT2/3 dependence on the horizon T and Euclidean path length PT for fixed dimension, while the optimal cost of dimension remained unresolved. We resolve this question by establishing a sharp d1/3 curved dimension factor, improving the d2/3 factor of recent switching and interval reductions [1, 2]. To achieve this improvement, we develop a proper, full-information learner on compact convex subsets of ℝd that adapts to the unknown path length and, under fixed dimension-independent diameter, gradient, and curvature parameters, guarantees operatornameRegT(u1:T) ≤ widetildeOleft(d+minleftd1/3T1/3PT2/3,√TPT,Trightright). A matching lower bound on a diameter-one Euclidean ball establishes the minimax frontier up to logarithmic factors when Tgtrsim d2, including the transition from the curved rate to larger path budgets. The lower bound already holds for losses that depend on only one coordinate per round, isolating an unavoidable cost of learning across directions. Our upper bound follows from square-root Gaussian KL control of comparator movement and a cancellation argument that pays for history restarts. The curved learner maintains O(log2 T) Gaussian states, uses one gradient per round, and runs in time near-linear in T under a Mahalanobis-projection oracle.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 27 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

17 of 27 references.

References · 17

  1. 2013Non-stationary Stochastic Optimizationcited by 175
  2. 2018Adaptive Online Learning in Dynamic Environmentscited by 133
  3. 2015Strongly Adaptive Online Learningcited by 107
  4. 2016Improved Strongly Adaptive Online Learning using Coin Bettingcited by 50
  5. 2013Dynamical Models and Tracking Regret in Online Convex Programmingcited by 43
  6. 2021Optimal Dynamic Regret in Exp-Concave Online Learningcited by 40
  7. 2019Online Forecasting of Total-Variation-bounded Sequencescited by 31
  8. 2022Optimal Dynamic Regret in Proper Online Learning with Strongly Convex Losses and Beyondcited by 28
  9. 2022Quasi-Newton Steps for Efficient Online Exp-Concave Optimizationcited by 10
  10. 2025Non-stationary Online Learning for Curved Losses: Improved Dynamic Regret via Mixabilitycited by 7
  11. 2024Online Convex Optimisation: The Optimal Switching Regret for all Segmentations Simultaneouslycited by 6
  12. 2025Dynamic Regret Reduces to Kernelized Static Regretcited by 5
5 more
  1. 2026Dynamic Regret via Discounted-to-Dynamic Reduction with Applications to Curved Losses and Adam Optimizercited by 4
  2. 2025A Simple, Optimal and Efficient Algorithm for Online Exp-Concave Optimizationcited by 3
  3. 2021Near-Linear Time Algorithm with Near-Logarithmic Regret Per Switch for Mixable/Exp-Concave Lossescited by 1
  4. 2026From Switching to Dynamic Regret: A Simple Reduction via Unbiased Random Sequencescited by 1
  5. 2026On the Relation Between Interval Regret and Dynamic Regretcited by 1

Built on by

Not cited yet.