mlsanityData to 14 Oct 2026

High-Probability Regret Bounds for Feel-Good Thompson Sampling

arXiv 2610.19513 ↗First posted 14 Oct 2026stat.ML cs.IT cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Feel-good Thompson sampling (FGTS) augments the posterior of vanilla Thompson sampling with an exploration term that favors reward functions with high predicted optimal values. This modification achieves minimax-optimal regret up to logarithmic factors in linear contextual bandits, but existing analyses of its two standard variants establish regret guarantees in expectation. In this paper, we derive the first high-probability regret bounds for both cumulative and current-step FGTS in contextual bandits with general realizable function approximation. Our bounds depend on the corresponding decoupling coefficients and the prior mass near the true reward function. In the d-dimensional linear setting, both variants satisfy Regret(T)=Obig(d√ Tlog(2T)+√ Tlog(1/δ)big) with probability at least 1-δ, where T is the time horizon. This bound matches the dimension and horizon dependence of algorithms based on the upper confidence bounds, up to logarithmic factors. Relative to the expected-regret guarantees, the cost of controlling the regret with high probability is confined to additive terms with at most linear dependence on log(1/δ). The proof ideas are partially developed by GPT-6 Astra under the authors' guidance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 16 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

7 of 16 references.

References · 7

  1. 2020Beyond UCB: Optimal and Efficient Contextual Bandits with Regression Oraclescited by 197
  2. 2018Practical Contextual Bandits with Regression Oraclescited by 93
  3. 2021Feel-Good Thompson Sampling for Contextual Bandits and Reinforcement Learningcited by 66
  4. 2022Model-based RL with Optimistic Posterior Sampling: Structural Conditions and Sample Complexitycited by 32
  5. 2022A Provably Efficient Model-Free Posterior Sampling Method for Episodic Reinforcement Learningcited by 31
  6. 2024Feel-Good Thompson Sampling for Contextual Dueling Banditscited by 27
  7. 2025Variance-Aware Feel-Good Thompson Sampling for Contextual Banditscited by 2

Built on by

Not cited yet.