Bellman-sufficient Information Complexity
Not on the map. Why?
Abstract (arXiv)
We introduce Bellman-sufficient information complexity for minimax analysis of sequential decision problems. A Bellman-sufficient state retains enough of the history to close the controlled recursion, while an index Y=chi(Omega) specifies the decision-relevant information being charged. The upper bound is a log-penalized Bellman program; the lower bound is a Bellman--Fano comparison along an algorithm-dependent reference trajectory. If the two values match at a common localization scale and the stated admissibility, calibration, and growth conditions hold, they form an information-risk sandwich. UCB, E2D, and AMS/EBO control or relax the upper Bellman bracket in different ways. For the main application, we give a negative answer to a widely studied form of the GP--UCB minimax-optimality question. For every 0<α<1/4, we construct one bounded continuous kernel whose minimax regret is Theta(T1-α) along an infinite sequence of horizons, while two globally calibrated GP--UCB rules incur linear regret under one fixed truth. An epochwise finite-marginal action-index AIR Bellman policy, implemented through robust AIR/AMS/EBO control, attains the minimax order. The construction separates realized information from the cost of uniform optimism: many low-value directions inflate the exploration multiplier and change the trajectory. Through the canonical RKHS feature map, it also yields a finite-horizon polynomial minimax separation for the specified maximal-information-calibrated LinUCB rule. A reproducible experiment illustrates the mechanism.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 41 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
7 of 41 references.
References · 7
- 2021The Statistical Complexity of Interactive Decision Makingcited by 218
- 2023Tight Guarantees for Interactive Decision Making with the Decision-Estimation Coefficientcited by 30
- 2024Assouad, Fano, and Le Cam with Interaction: A Unifying Lower Bound Framework and Characterization for Bandit Learnabilitycited by 12
- 2023On the Suboptimality of GP-UCB under Polynomial Effective Optimismcited by 4
- 2026Pointwise Generalization in Deep Neural Networkscited by 4
- 2026Pointwise Complexity for Gaussian Fields: Upper Envelopes, Algorithmic Lower Bounds, and Separationcited by 2
- 2022Truncated LinUCB for Stochastic Linear Banditscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Local Search with Correlated Randomnesscited by 0
- 2026Local Search with Correlated Randomness20 Jul 2026