mlsanityData to 14 Oct 2026

Minimax Adaptive Online Nonparametric Regression over Besov Spaces

arXiv 2505.19741 ↗First posted 26 May 2025math.ST stat.ML stat.THcited by 1

Not on the map. Why?

Abstract (arXiv)

We study online adversarial regression with convex losses against a rich class of continuous yet highly irregular prediction rules, modeled by Besov spaces Bpqs with general parameters 1 ≤ p,q ≤ ∞ and smoothness s > tfracdp. We introduce an adaptive wavelet-based algorithm that performs sequential prediction without prior knowledge of (s,p,q), and establish minimax-optimal regret bounds against any comparator in Bpqs. We further design a locally adaptive extension capable of dynamically tracking spatially inhomogeneous smoothness. This adaptive mechanism adjusts the resolution of the predictions over both time and space, yielding refined regret bounds in terms of local regularity. Consequently, in heterogeneous environments, our adaptive guarantees can significantly surpass those obtained by standard global methods.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 48 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

17 of 48 references.

References · 17

  1. 2019Introduction to Online Convex Optimizationcited by 803
  2. 2016Coin Betting and Parameter-Free Online Learningcited by 133
  3. 2018Black-Box Reductions for Parameter-free Online Learning in Banach Spacescited by 125
  4. 2014A Second-order Bound with Excess Lossescited by 95
  5. 2020Lipschitz and Comparator-Norm Adaptivity in Online Learningcited by 57
  6. 2015Second-order Quantile Methods for Experts and Combinatorial Gamescited by 49
  7. 2014Optimal learning with Bernstein Online Aggregationcited by 35
  8. 2015A Chaining Algorithm for Online Nonparametric Regressioncited by 16
  9. 2015Online Nonparametric Regression with General Loss Functionscited by 14
  10. 2017Second-Order Kernel Online Convex Optimization with Adaptive Sketchingcited by 13
  11. 2019Efficient online learning with kernels for adversarial large scale problemscited by 12
  12. 2023Unconstrained Dynamic Regret via Sparse Codingcited by 11
5 more
  1. 2020Locally-Adaptive Nonparametric Online Learningcited by 8
  2. 2021Online nonparametric regression with Sobolev kernelscited by 5
  3. 2023Near-optimal learning with average H"older smoothnesscited by 4
  4. 2023Efficient Agnostic Learning with Average Smoothnesscited by 1
  5. 2024Minimax-optimal and Locally-adaptive Online Nonparametric Regressioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.