Catching a Moving Subspace: Low-Rank Bandits Beyond Stationarity
Not on the map. Why?
Abstract (arXiv)
Many bandit deployments (recommendation, clinical dosing, ad targeting) share two facts prior work handles only in isolation: rewards live on a low-dimensional latent subspace, and that subspace drifts. Stationary low-rank bandits exploit rank but break under subspace change; non-stationary linear bandits adapt to drift but pay ambient rate widetildeO(d√T). We study piecewise-stationary low-rank linear contextual bandits with scalar feedback: θt = Bk^star wt with rank-r factor Bk^star∈ℝd× r constant within each of K unknown segments and able to shift at boundaries. Our results are tight along three axes. (i) Identification boundary. With single-play scalar rewards, the moving subspace is recoverable through quadratic functionals of rewards iff three probe-side conditions hold: known noise variance, bounded state-noise coupling, and full-dimensional probe support. Each is necessary in the unrestricted-second-moment problem, and jointly they are sufficient, characterizing the boundary of the solvable region. (ii) Algorithm and dynamic regret. SPSC interleaves isotropic probes with windowed projected ridge-UCB exploitation inside the learned r-dimensional subspace; a CUSUM-style variant discovers segment boundaries online. The costed dynamic regret is widetildeO(r√T)+widetildeO(T2/3)+O(W,Vin), replacing the ambient d√T rate with the intrinsic rank. (iii) Empirics. On eleven benchmarks spanning synthetic, UCI/MovieLens, semi-synthetic clinical, and ZOZOTOWN production-log data, SPSC outperforms non-stationary and low-rank baselines whenever d-rgtrsim T1/6, matching the analytical crossover. To our knowledge, this is the first work to characterize the identification boundary and attain the intrinsic-rank dynamic-regret rate in this setting.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
13 of 26 references.
References · 13
- 2019Weighted Linear Bandits for Non-Stationary Environmentscited by 86
- 2018Learning to Optimize under Non-Stationaritycited by 85
- 2020Open Bandit Dataset and Pipeline: Towards Realistic and Reproducible Off-Policy Evaluationcited by 77
- 2019Bilinear Bandits with Low-rank Structurecited by 55
- 2020Low-Rank Generalized Linear Bandit Problemscited by 49
- 2022A New Look at Dynamic Regret for Non-Stationary Stochastic Banditscited by 28
- 2024Efficient Frameworks for Generalized Low-Rank Matrix Bandit Problemscited by 20
- 2023Spectral Entry-wise Matrix Estimation for Low-Rank Reinforcement Learningcited by 10
- 2024Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Banditscited by 10
- 2021Finite-time Analysis of Globally Nonstationary Multi-Armed Banditscited by 7
- 2024Low-Rank Bandits via Tight Two-to-Infinity Singular Subspace Recoverycited by 6
- 2024Almost Minimax Optimal Best Arm Identification in Piecewise Stationary Linear Banditscited by 6
1 more
- 2025Calibrated Recommendations with Contextual Banditscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.