mlsanityData to 14 Oct 2026

Parameter-Free Interval-Dynamic Regret under Heavy-Tailed Noise

arXiv 2610.02258 ↗First posted 30 Sep 2026cs.LG cs.IT math.ITcited by 0

Not on the map. Why?

Abstract (arXiv)

We study online convex optimization with one unbiased stochastic subgradient per round and an unknown finite conditional pth noise moment, 1<p≤2. For every fixed interval I of length n and comparator path with LambdaI=1+PI/D, one learner achieves [ E[RegretI(u)]≤min(GDn, C[GD√n(LambdaI+log2(2T)) +σ Dn1/p(LambdaI+log2(2T))(p-1)/p]). ] The learner uses none of G,σ,p,I,PI, and the constant is universal. Interval adaptation adds to comparator complexity, preserving the distinct mean-gradient and noise exponents. The analysis controls calibration in expectation and limits the cost of observation-scale changes. Its general theorem compares to distributions over predictably available experts with relative-entropy dependence on a nonuniform prior. A common prior favors long windows and long restart lengths. With the statistics supplied, the interval cost becomes 1+log(T/n), including the optimal full-horizon static rate. A change-of-measure lower bound identifies the noise power of this logarithm for learners retaining a full-horizon optimal guarantee, under explicit conditions. Static comparisons and deterministic partitions follow from the same decisions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 19 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

13 of 19 references.

References · 13

  1. 2018Adaptive Online Learning in Dynamic Environmentscited by 133
  2. 2015Strongly Adaptive Online Learningcited by 107
  3. 2014A Second-order Bound with Excess Lossescited by 95
  4. 2016Scale-Free Online Learningcited by 85
  5. 2013Follow the Leader If You Can, Hedge If You Mustcited by 70
  6. 2016Improved Strongly Adaptive Online Learning using Coin Bettingcited by 50
  7. 2020Minimizing Dynamic Regret and Adaptive Regret Simultaneouslycited by 31
  8. 2022Parameter-free Regret in High Probability with Heavy Tailscited by 28
  9. 2022Mirror Descent Strikes Again: Optimal Stochastic Convex Optimization under Infinite Noise Variancecited by 24
  10. 2025Online Convex Optimization with Heavy Tails: Old Algorithms, New Regrets, and Applicationscited by 17
  11. 2025When Lower-Order Terms Dominate: Adaptive Expert Algorithms for Heavy-Tailed Lossescited by 2
  12. 2026Online Learning with Gradient-Variation Interval Regretcited by 2
1 more
  1. 2026Parameter-Free Dynamic Regret under Heavy-Tailed Noisecited by 1

Built on by

Not cited yet.