Adaptive Bayes exactly tracks information over intrinsic time
Not on the map. Why?
Abstract (arXiv)
Bayesian and multiplicative-weights updates reweight experts, models, or actions from sequential feedback. We show that the regret of any such update obeys an exact information-accounting identity. On each round, the learner's excess loss to any chosen comparator is the sum of an immediate cost for the uncertainty exposed by the round and a reduction in the information distance from the learner's current weights to the comparator. The cumulative cost defines a pathwise uncertainty clock, the intrinsic time of the realized sequence. Summing one-step balances yields two exact adaptive decompositions of cumulative regret, one for each natural way of composing the update across rounds. Because the decompositions are exact, favorable stochastic or low-noise regimes appear as self-bounding properties of the realized intrinsic time. The accounting also fixes a learning rate, inverse in the square root of intrinsic time. That schedule is competitive with adaptive baselines in selected online-learning settings. The same calculus covers Hedge, optimistic and side-information variants, continuous priors, boosting, online convex optimization, contextual bandits, and repeated games: the pathwise account is the same in every case.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 5 of its 73 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
5 of 73 references.
References · 5
- 2014Inconsistency of Bayesian Inference for Misspecified Linear Models, and a Proposal for Repairing Itcited by 95
- 2026A second order regret bound for NormalHedgecited by 4
- 2026Information from coincidencescited by 4
- 2014Sharp Finite-Time Iterated-Logarithm Martingale Concentrationcited by 1
- 2026A Short Note on a Variant of the Squint Algorithmcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026The concentration game: Bayesian updating, regret, and informationcited by 0
- 2026Exact information accounting for SGD methodscited by 0
- 2026Exact information accounting for SGD methods30 Sep 2026
- 2026The concentration game: Bayesian updating, regret, and information18 Aug 2026