On Multi-Armed Bandit Designs for Dose-Finding Clinical Trials
Not on the map. Why?
Abstract (arXiv)
We study the problem of finding the optimal dosage in early stage clinical trials through the multi-armed bandit lens. We advocate the use of the Thompson Sampling principle, a flexible algorithm that can accommodate different types of monotonicity assumptions on the toxicity and efficacy of the doses. For the simplest version of Thompson Sampling, based on a uniform prior distribution for each dose, we provide finite-time upper bounds on the number of sub-optimal dose selections, which is unprecedented for dose-finding algorithms. Through a large simulation study, we then show that variants of Thompson Sampling based on more sophisticated prior distributions outperform state-of-the-art dose identification algorithms in different types of dose-finding studies that occur in phase I or phase I/II trials.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 6; 2023: 6; 2024: 7; 2025: 7; 2026: 1.
32 papers.
Sort:
- 2021Best Arm Identification with Safety Constraintscited by 25
- 2021Efficient Online Bayesian Inference for Neural Banditscited by 15
- 2024Sliding-Window Thompson Sampling for Non-Stationary Settingscited by 15
- 2022Strategies for Safe Multi-Armed Bandits with Logarithmic Regret and Riskcited by 14
- 2025Multi-Armed Bandits With Machine Learning-Generated Surrogate Rewardscited by 13
- 2022Reinforcement Learning and Bandits for Speech and Language Processing: Tutorial, Review and Outlookcited by 10
- 2023Pure Exploration in Bandits with Linear Constraintscited by 10
- 2022Multi-disciplinary fairness considerations in machine learning for clinical trialscited by 8
- 2022Meta Learning of Interface Conditions for Multi-Domain Physics-Informed Neural Networkscited by 6
- 2023On the Complexity of Differentially Private Best-Arm Identification with Fixed Confidencecited by 6
- 2021ESCADA: Efficient Safety and Context Aware Dose Allocation for Precision Medicinecited by 5
- 2023The Best Arm Evades: Near-optimal Multi-pass Streaming Lower Bounds for Pure Exploration in Multi-armed Banditscited by 5
20 more
- 2022The Survival Bandit Problemcited by 4
- 2021Debiasing Samples from Online Learning Using Bootstrapcited by 3
- 2024Thompson Sampling for Stochastic Bandits with Noisy Contexts: An Information-Theoretic Regret Analysiscited by 2
- 2024Graph Feedback Bandits with Similar Armscited by 2
- 2025Strategic Multi-Armed Bandit Problems Under Debt-Free Reportingcited by 2
- 2021Safe Linear Leveling Banditscited by 1
- 2022Benefits of Monotonicity in Safe Exploration with Gaussian Processescited by 1
- 2023Federated Learning for Heterogeneous Bandits with Unobserved Contextscited by 1
- 2023Piecewise-Stationary Combinatorial Semi-Bandit with Causally Related Rewardscited by 1
- 2024Indirect Query Bayesian Optimization with Integrated Feedbackcited by 1
- 2025LNUCB-TA: Linear-nonlinear Hybrid Bandit Learning with Temporal Attentioncited by 1
- 2025COBRA: Contextual Bandit Algorithm for Ensuring Truthful Strategic Agentscited by 1
- 2023AI in Pharma for Personalized Sequential Decision-Making: Methods, Applications and Opportunitiescited by 0
- 2024Privacy-Preserving UCB Decision Process Verification via zk-SNARKscited by 0
- 2024Learning to Explore with Lagrangians for Bandits under Unknown Linear Constraintscited by 0
- 2024Multi-armed Bandits with Missing Outcomecited by 0
- 2025Constrained Linear Thompson Samplingcited by 0
- 2025Cost-Aware Optimal Pairwise Pure Explorationcited by 0
- 2025Co-Exploration and Co-Exploitation via Shared Structure in Multi-Task Banditscited by 0
- 2026Safety by Design: Realized-Cost Constraints for Contextual Bandits with Continuous Actionscited by 0
- 2026Safety by Design: Realized-Cost Constraints for Contextual Bandits with Continuous Actions27 Aug 2026
- 2025Co-Exploration and Co-Exploitation via Shared Structure in Multi-Task Bandits14 Dec 2025
- 2025Multi-Armed Bandits With Machine Learning-Generated Surrogate Rewards20 Jun 2025
- 2025COBRA: Contextual Bandit Algorithm for Ensuring Truthful Strategic Agents29 May 2025
- 2025Cost-Aware Optimal Pairwise Pure Exploration10 Mar 2025
- 2025Constrained Linear Thompson Sampling3 Mar 2025
- 2025LNUCB-TA: Linear-nonlinear Hybrid Bandit Learning with Temporal Attention1 Mar 2025
- 2025Strategic Multi-Armed Bandit Problems Under Debt-Free Reporting27 Jan 2025
- 2024Indirect Query Bayesian Optimization with Integrated Feedback18 Dec 2024
- 2024Multi-armed Bandits with Missing Outcome8 Nov 2024
- 2024Learning to Explore with Lagrangians for Bandits under Unknown Linear Constraints24 Oct 2024
- 2024Sliding-Window Thompson Sampling for Non-Stationary Settings8 Sep 2024
20 more
- 2024Graph Feedback Bandits with Similar Arms18 May 2024
- 2024Privacy-Preserving UCB Decision Process Verification via zk-SNARKs18 Apr 2024
- 2024Thompson Sampling for Stochastic Bandits with Noisy Contexts: An Information-Theoretic Regret Analysis21 Jan 2024
- 2023AI in Pharma for Personalized Sequential Decision-Making: Methods, Applications and Opportunities30 Nov 2023
- 2023The Best Arm Evades: Near-optimal Multi-pass Streaming Lower Bounds for Pure Exploration in Multi-armed Bandits6 Sep 2023
- 2023On the Complexity of Differentially Private Best-Arm Identification with Fixed Confidence5 Sep 2023
- 2023Piecewise-Stationary Combinatorial Semi-Bandit with Causally Related Rewards26 Jul 2023
- 2023Pure Exploration in Bandits with Linear Constraints22 Jun 2023
- 2023Federated Learning for Heterogeneous Bandits with Unobserved Contexts29 Mar 2023
- 2022Benefits of Monotonicity in Safe Exploration with Gaussian Processes3 Nov 2022
- 2022Reinforcement Learning and Bandits for Speech and Language Processing: Tutorial, Review and Outlook24 Oct 2022
- 2022Meta Learning of Interface Conditions for Multi-Domain Physics-Informed Neural Networks23 Oct 2022
- 2022The Survival Bandit Problem7 Jun 2022
- 2022Multi-disciplinary fairness considerations in machine learning for clinical trials18 May 2022
- 2022Strategies for Safe Multi-Armed Bandits with Logarithmic Regret and Risk1 Apr 2022
- 2021Safe Linear Leveling Bandits13 Dec 2021
- 2021Efficient Online Bayesian Inference for Neural Bandits1 Dec 2021
- 2021ESCADA: Efficient Safety and Context Aware Dose Allocation for Precision Medicine26 Nov 2021
- 2021Best Arm Identification with Safety Constraints23 Nov 2021
- 2021Debiasing Samples from Online Learning Using Bootstrap31 Jul 2021
- 2021Best Arm Identification with Safety Constraintscited by 25
- 2021Efficient Online Bayesian Inference for Neural Banditscited by 15
- 2024Sliding-Window Thompson Sampling for Non-Stationary Settingscited by 15
- 2022Strategies for Safe Multi-Armed Bandits with Logarithmic Regret and Riskcited by 14
- 2025Multi-Armed Bandits With Machine Learning-Generated Surrogate Rewardscited by 13
- 2022Reinforcement Learning and Bandits for Speech and Language Processing: Tutorial, Review and Outlookcited by 10
- 2023Pure Exploration in Bandits with Linear Constraintscited by 10
- 2022Multi-disciplinary fairness considerations in machine learning for clinical trialscited by 8
- 2022Meta Learning of Interface Conditions for Multi-Domain Physics-Informed Neural Networkscited by 6
- 2023On the Complexity of Differentially Private Best-Arm Identification with Fixed Confidencecited by 6
- 2021ESCADA: Efficient Safety and Context Aware Dose Allocation for Precision Medicinecited by 5
- 2023The Best Arm Evades: Near-optimal Multi-pass Streaming Lower Bounds for Pure Exploration in Multi-armed Banditscited by 5
12 most cited of 32 All 32 (JSON)
- 2026Safety by Design: Realized-Cost Constraints for Contextual Bandits with Continuous Actions27 Aug 2026
- 2025Co-Exploration and Co-Exploitation via Shared Structure in Multi-Task Bandits14 Dec 2025
- 2025Multi-Armed Bandits With Machine Learning-Generated Surrogate Rewards20 Jun 2025
- 2025COBRA: Contextual Bandit Algorithm for Ensuring Truthful Strategic Agents29 May 2025
- 2025Cost-Aware Optimal Pairwise Pure Exploration10 Mar 2025
- 2025Constrained Linear Thompson Sampling3 Mar 2025
- 2025LNUCB-TA: Linear-nonlinear Hybrid Bandit Learning with Temporal Attention1 Mar 2025
- 2025Strategic Multi-Armed Bandit Problems Under Debt-Free Reporting27 Jan 2025
- 2024Indirect Query Bayesian Optimization with Integrated Feedback18 Dec 2024
- 2024Multi-armed Bandits with Missing Outcome8 Nov 2024
- 2024Learning to Explore with Lagrangians for Bandits under Unknown Linear Constraints24 Oct 2024
- 2024Sliding-Window Thompson Sampling for Non-Stationary Settings8 Sep 2024
12 newest of 32 All 32 (JSON)