mlsanityData to 14 Oct 2026

Adaptive Bayes exactly tracks information over intrinsic time

arXiv 2607.08789 ↗First posted 26 Jun 2026cs.LG cs.IT math.ITcited by 2

Not on the map. Why?

Abstract (arXiv)

Bayesian and multiplicative-weights updates reweight experts, models, or actions from sequential feedback. We show that the regret of any such update obeys an exact information-accounting identity. On each round, the learner's excess loss to any chosen comparator is the sum of an immediate cost for the uncertainty exposed by the round and a reduction in the information distance from the learner's current weights to the comparator. The cumulative cost defines a pathwise uncertainty clock, the intrinsic time of the realized sequence. Summing one-step balances yields two exact adaptive decompositions of cumulative regret, one for each natural way of composing the update across rounds. Because the decompositions are exact, favorable stochastic or low-noise regimes appear as self-bounding properties of the realized intrinsic time. The accounting also fixes a learning rate, inverse in the square root of intrinsic time. That schedule is competitive with adaptive baselines in selected online-learning settings. The same calculus covers Hedge, optimistic and side-information variants, continuous priors, boosting, online convex optimization, contextual bandits, and repeated games: the pathwise account is the same in every case.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 5 of its 73 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

5 of 73 references.

References · 5

  1. 2014Inconsistency of Bayesian Inference for Misspecified Linear Models, and a Proposal for Repairing Itcited by 95
  2. 2026A second order regret bound for NormalHedgecited by 4
  3. 2026Information from coincidencescited by 4
  4. 2014Sharp Finite-Time Iterated-Logarithm Martingale Concentrationcited by 1
  5. 2026A Short Note on a Variant of the Squint Algorithmcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.