Active Adaptive Experimental Design for Treatment Effect Estimation with Covariate Choices
Not on the map. Why?
Abstract (arXiv)
This study designs an adaptive experiment for efficiently estimating average treatment effects (ATEs). In each round of our adaptive experiment, an experimenter sequentially samples an experimental unit, assigns a treatment, and observes the corresponding outcome immediately. At the end of the experiment, the experimenter estimates an ATE using the gathered samples. The objective is to estimate the ATE with a smaller asymptotic variance. Existing studies have designed experiments that adaptively optimize the propensity score (treatment-assignment probability). As a generalization of such an approach, we propose optimizing the covariate density as well as the propensity score. First, we derive the efficient covariate density and propensity score that minimize the semiparametric efficiency bound and find that optimizing both covariate density and propensity score minimizes the semiparametric efficiency bound more effectively than optimizing only the propensity score. Next, we design an adaptive experiment using the efficient covariate density and propensity score sequentially estimated during the experiment. Lastly, we propose an ATE estimator whose asymptotic variance aligns with the minimized semiparametric efficiency bound.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 26 of its 82 references that are in the map. First posted on arXiv 6 Mar 2024.
Builds on
26 of 82 references.
References · 26
- 2014On the Complexity of Best Arm Identification in Multi-Armed Bandit Modelscited by 280
- 2016Optimal Best Arm Identification with Fixed Confidencecited by 233
- 2018Time-uniform, nonparametric, nonasymptotic confidence sequencescited by 220
- 2020Estimating means of bounded random variables by bettingcited by 164
- 2016Simple Bayesian Algorithms for Best Arm Identificationcited by 116
- 2015Multi-armed Bandit Models for the Optimal Design of Clinical Trials: Benefits and Challengescited by 113
- 2019Confidence Intervals for Policy Evaluation in Adaptive Experimentscited by 95
- 2020Inference for Batched Banditscited by 63
- 2021Off-Policy Evaluation via Adaptive Weighting with Data from Contextual Banditscited by 40
- 2022Anytime-valid off-policy inference for contextual banditscited by 37
- 2018Pool-Based Sequential Active Learning for Regressioncited by 33
- 2021Post-Contextual-Bandit Inferencecited by 32
14 more
- 2020Off-Policy Evaluation and Learning for External Validity under a Covariate Shiftcited by 26
- 2023Semiparametric Efficient Inference in Adaptive Experimentscited by 23
- 2015Sequential Nonparametric Testing with the Law of the Iterated Logarithmcited by 19
- 2023On the Existence of a Complexity in Fixed Budget Bandit Identificationcited by 19
- 2021A/B/n Testing with Control in the Presence of Subpopulationscited by 17
- 2023Clip-OGD: An Experimental Design for Adaptive Neyman Allocation in Sequential Experimentscited by 16
- 2018Efficient Counterfactual Learning from Bandit Feedbackcited by 15
- 2018Stratification Trees for Adaptive Randomization in Randomized Controlled Trialscited by 14
- 2021Efficient Online Estimation of Causal Effects by Deciding What to Observecited by 11
- 2021The Role of Contextual Information in Best Arm Identificationcited by 8
- 2022Nonparametric extensions of randomized response for private confidence setscited by 6
- 2023Double machine learning and design in batch adaptive experimentscited by 4
- 2023Asymptotically Optimal Fixed-Budget Best Arm Identification with Variance-Dependent Boundscited by 3
- 2023Locally Optimal Fixed-Budget Best Arm Identification in Two-Armed Gaussian Bandits with Unknown Variancescited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 6; 2026: 4.
12 papers.
- 2024Unraveling the Interplay between Carryover Effects and Reward Autocorrelations in Switchback Experimentscited by 6
- 2024Optimal Adaptive Experimental Design for Estimating Treatment Effectcited by 5
- 2025Balancing Interference and Correlation in Spatial Experimental Designs: A Causal Graph Cut Approachcited by 5
- 2025Efficient Adaptive Experimentation with Noncompliancecited by 2
- 2025Causal-EPIG: A Prediction-Oriented Active Learning Framework for CATE Estimationcited by 2
- 2025ActiveCQ: Active Estimation of Causal Quantitiescited by 1
- 2026Designing Time Series Experiments in A/B Testing with Transformer Reinforcement Learningcited by 1
- 2026Observationally Informed Adaptive Causal Experimental Designcited by 1
- 2025Semi-Supervised Treatment Effect Estimation with Unlabeled Covariates for Prediction-Powered Causal Inferencecited by 0
- 2025Minimax and Bayes Optimal Adaptive Experimental Design for Treatment Choicecited by 0
- 2026Robust Sequential Experimental Design for A/B Testingcited by 0
- 2026Adaptive Experimentation for Censored Survival Outcomescited by 0
- 2026Adaptive Experimentation for Censored Survival Outcomes18 May 2026
- 2026Robust Sequential Experimental Design for A/B Testing13 May 2026
- 2026Observationally Informed Adaptive Causal Experimental Design4 Mar 2026
- 2026Designing Time Series Experiments in A/B Testing with Transformer Reinforcement Learning2 Feb 2026
- 2025Minimax and Bayes Optimal Adaptive Experimental Design for Treatment Choice9 Dec 2025
- 2025Semi-Supervised Treatment Effect Estimation with Unlabeled Covariates for Prediction-Powered Causal Inference11 Nov 2025
- 2025ActiveCQ: Active Estimation of Causal Quantities29 Sep 2025
- 2025Causal-EPIG: A Prediction-Oriented Active Learning Framework for CATE Estimation26 Sep 2025
- 2025Balancing Interference and Correlation in Spatial Experimental Designs: A Causal Graph Cut Approach26 May 2025
- 2025Efficient Adaptive Experimentation with Noncompliance23 May 2025
- 2024Optimal Adaptive Experimental Design for Estimating Treatment Effect7 Oct 2024
- 2024Unraveling the Interplay between Carryover Effects and Reward Autocorrelations in Switchback Experiments26 Mar 2024