mlsanityData to 14 Oct 2026

When May a Bandit Leave Its Anchor? E-Process-Authorized Thompson Sampling under Non-stationarity

arXiv 2610.03646 ↗First posted 2 Oct 2026cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Stationarity rewards memory, but after a change the same history can mislead. We ask when forgetting should be permitted. E-process-authorized Thompson sampling (e-ATS) gives each arm full-history and discounted Beta states. An anytime-valid e-process first authorizes the discounted state, then a reversible relevance score controls its influence. Before authorization, e-ATS exactly follows optimistic Thompson sampling (OTS). Under a Beta-Bernoulli prior-predictive stationary model, e-ATS's probability of ever departing from OTS is at most the chosen αE, without fitted thresholds. Relative to e-ATS, removing authorization increased mean normalized dynamic pseudo-regret by 38.4% on the registered suite but reduced it by 7.5% on the literature-derived replay suite. Therefore, evidence controls when adaptation begins, not whether it always helps.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 21 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

13 of 21 references.

References · 13

  1. 2022Game-theoretic statistics and safe anytime-valid inferencecited by 155
  2. 2019Safe Testingcited by 101
  3. 2019Weighted Linear Bandits for Non-Stationary Environmentscited by 86
  4. 2016Conservative Banditscited by 59
  5. 2018Nearly Optimal Adaptive Procedure with Change Detection for Piecewise-Stationary Banditcited by 50
  6. 2017A Change-Detection based Framework for Piecewise-stationary Multi-Armed Bandit Problemcited by 49
  7. 2014Optimal Exploration-Exploitation in a Multi-Armed-Bandit Problem with Non-stationary Rewardscited by 42
  8. 2017Taming Non-stationary Bandits: A Bayesian Approachcited by 32
  9. 2021Testing exchangeability: fork-convexity, supermartingales, and e-processescited by 32
  10. 2022E-detectors: a nonparametric framework for sequential change detectioncited by 32
  11. 2024Sliding-Window Thompson Sampling for Non-Stationary Settingscited by 17
  12. 2013Thompson Sampling in Switching Environments with Bayesian Online Change Point Detectioncited by 9
1 more
  1. 2017On Adaptive Estimation for Dynamic Bernoulli Banditscited by 2

Built on by

Not cited yet.