Bounded Regret for Finite-Armed Structured Bandits
Not on the map. Why?
Abstract (arXiv)
We study a new type of K-armed bandit problem where the expected return of one arm may depend on the returns of other arms. We present a new algorithm for this general class of problems and show that under certain circumstances it is possible to achieve finite expected cumulative regret. We also give problem-dependent lower bounds on the cumulative regret showing that at least in special cases the new algorithm is nearly optimal.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Nov 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 2; 2023: 2; 2024: 3; 2025: 1; 2026: 1.
15 papers.
Sort:
By area:
- 2021Feel-Good Thompson Sampling for Contextual Bandits and Reinforcement Learningcited by 66
- 2022Deep Hierarchy in Banditscited by 19
- 2022Mixed-Effect Thompson Samplingcited by 14
- 2021Best-Arm Identification in Correlated Multi-Armed Banditscited by 8
- 2023Thompson Sampling with Diffusion Generative Priorcited by 7
- 2021Thompson Sampling for Bandits with Clustered Armscited by 6
- 2024Causally Abstracted Multi-armed Banditscited by 6
- 2024Experiment Planning with Function Approximationcited by 5
- 2024Diffusion Models Meet Contextual Banditscited by 5
- 2023Quantum contextual bandits and recommender systems for quantum datacited by 4
- 2021Bad-Policy Density: A Measure of Reinforcement Learning Hardnesscited by 2
- 2021Best Arm Identification under Additive Transfer Banditscited by 1
3 more
- 2025A Classification View on Meta Learning Banditscited by 1
- 2021TSEC: a framework for online experimentation under experimental constraintscited by 0
- 2026Latent Order Banditscited by 0
- 2026Latent Order Bandits8 May 2026
- 2025A Classification View on Meta Learning Bandits6 Apr 2025
- 2024Causally Abstracted Multi-armed Bandits26 Apr 2024
- 2024Diffusion Models Meet Contextual Bandits15 Feb 2024
- 2024Experiment Planning with Function Approximation10 Jan 2024
- 2023Quantum contextual bandits and recommender systems for quantum data31 Jan 2023
- 2023Thompson Sampling with Diffusion Generative Prior12 Jan 2023
- 2022Mixed-Effect Thompson Sampling30 May 2022
- 2022Deep Hierarchy in Bandits3 Feb 2022
- 2021Best Arm Identification under Additive Transfer Bandits8 Dec 2021
- 2021Bad-Policy Density: A Measure of Reinforcement Learning Hardness7 Oct 2021
- 2021Feel-Good Thompson Sampling for Contextual Bandits and Reinforcement Learning2 Oct 2021
3 more
- 2023Thompson Sampling with Diffusion Generative Priorcited by 7
- 2024Diffusion Models Meet Contextual Banditscited by 5
- 2024Diffusion Models Meet Contextual Bandits15 Feb 2024
- 2023Thompson Sampling with Diffusion Generative Prior12 Jan 2023
- 2021Feel-Good Thompson Sampling for Contextual Bandits and Reinforcement Learningcited by 66
- 2022Deep Hierarchy in Banditscited by 19
- 2022Mixed-Effect Thompson Samplingcited by 14
- 2021Best-Arm Identification in Correlated Multi-Armed Banditscited by 8
- 2021Thompson Sampling for Bandits with Clustered Armscited by 6
- 2024Causally Abstracted Multi-armed Banditscited by 6
- 2024Experiment Planning with Function Approximationcited by 5
- 2023Quantum contextual bandits and recommender systems for quantum datacited by 4
- 2021Bad-Policy Density: A Measure of Reinforcement Learning Hardnesscited by 2
- 2021Best Arm Identification under Additive Transfer Banditscited by 1
- 2025A Classification View on Meta Learning Banditscited by 1
- 2021TSEC: a framework for online experimentation under experimental constraintscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Latent Order Bandits8 May 2026
- 2025A Classification View on Meta Learning Bandits6 Apr 2025
- 2024Causally Abstracted Multi-armed Bandits26 Apr 2024
- 2024Experiment Planning with Function Approximation10 Jan 2024
- 2023Quantum contextual bandits and recommender systems for quantum data31 Jan 2023
- 2022Mixed-Effect Thompson Sampling30 May 2022
- 2022Deep Hierarchy in Bandits3 Feb 2022
- 2021Best Arm Identification under Additive Transfer Bandits8 Dec 2021
- 2021Bad-Policy Density: A Measure of Reinforcement Learning Hardness7 Oct 2021
- 2021Feel-Good Thompson Sampling for Contextual Bandits and Reinforcement Learning2 Oct 2021
- 2021Best-Arm Identification in Correlated Multi-Armed Bandits10 Sep 2021
- 2021Thompson Sampling for Bandits with Clustered Arms6 Sep 2021
12 newest of 13 All 13 (JSON)