Semiparametric Efficient Inference in Adaptive Experiments
Not on the map. Why?
Abstract (arXiv)
We consider the problem of efficient inference of the Average Treatment Effect in a sequential experiment where the policy governing the assignment of subjects to treatment or control can change over time. We first provide a central limit theorem for the Adaptive Augmented Inverse-Probability Weighted estimator, which is semiparametric efficient, under weaker assumptions than those previously made in the literature. This central limit theorem enables efficient inference at fixed sample sizes. We then consider a sequential inference setting, deriving both asymptotic and nonasymptotic confidence sequences that are considerably tighter than previous methods. These anytime-valid methods enable inference under data-dependent stopping times (sample sizes). Additionally, we use propensity score truncation techniques from the recent off-policy estimation literature to reduce the finite sample variance of our estimator without affecting the asymptotic variance. Empirical results demonstrate that our methods yield narrower confidence sequences than those previously developed in the literature while maintaining time-uniform error control.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 12 of its 24 references that are in the map. First posted on arXiv 30 Nov 2023.
Builds on
12 of 24 references.
References · 12
- 2018Time-uniform, nonparametric, nonasymptotic confidence sequencescited by 229
- 2020Estimating means of bounded random variables by bettingcited by 169
- 2022Game-theoretic statistics and safe anytime-valid inferencecited by 155
- 2019Confidence Intervals for Policy Evaluation in Adaptive Experimentscited by 95
- 2021Statistical Inference with M-Estimators on Adaptively Collected Datacited by 40
- 2022Anytime-valid off-policy inference for contextual banditscited by 37
- 2021Time-uniform central limit theory and asymptotic confidence sequencescited by 29
- 2020Efficient Adaptive Experimental Design for Average Treatment Effect Estimationcited by 23
- 2015Sequential Nonparametric Testing with the Law of the Iterated Logarithmcited by 20
- 2023Clip-OGD: An Experimental Design for Adaptive Neyman Allocation in Sequential Experimentscited by 16
- 2023On the near-optimality of betting confidence sets for bounded meanscited by 10
- 2022Asymptotic Efficiency Bounds for a Class of Experimental Designscited by 8
Built on by
Citing papers per year: 2024: 8; 2025: 8; 2026: 7.
23 papers.
Sort:
By area:
- 2024Active Statistical Inferencecited by 50
- 2024Active, anytime-valid risk controlling prediction setscited by 14
- 2024Active Adaptive Experimental Design for Treatment Effect Estimation with Covariate Choicescited by 12
- 2024Logarithmic Neyman Regret for Adaptive Estimation of the Average Treatment Effectcited by 4
- 2025Adaptive Off-Policy Inference for M-Estimators Under Model Misspecificationcited by 4
- 2026Efficient Sequential Evaluation of Large Language Modelscited by 4
- 2024Off-policy estimation with adaptively collected data: the power of online learningcited by 3
- 2024Adaptive Experimental Design for Policy Learningcited by 2
- 2025Optimistic Algorithms for Adaptive Estimation of the Average Treatment Effectcited by 2
- 2025Efficient Adaptive Experimentation with Noncompliancecited by 2
- 2025Causal-EPIG: A Prediction-Oriented Active Learning Framework for CATE Estimationcited by 2
- 2024Generalized Neyman Allocation for Locally Minimax Optimal Best-Arm Identificationcited by 1
11 more
- 2025Multi-Metric Adaptive Experimental Design Under a Fixed Budget with Validationcited by 1
- 2025Design Stability in Adaptive Experiments: Implications for Treatment Effect Estimationcited by 1
- 2026Observationally Informed Adaptive Causal Experimental Designcited by 1
- 2024Online Data Collection for Efficient Semiparametric Inferencecited by 0
- 2025On Pareto Optimality for Parametric Choice Banditscited by 0
- 2025Minimax and Bayes Optimal Adaptive Experimental Design for Treatment Choicecited by 0
- 2026Fixed-Horizon Self-Normalized Inference for Adaptive Experiments via Martingale AIPW/DML with Logged Propensitiescited by 0
- 2026What Do We Care About in Bandits with Noncompliance? BRACE: Bandits with Recommendations, Abstention, and Certified Effectscited by 0
- 2026Adaptive Experimentation for Censored Survival Outcomescited by 0
- 2026Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimationcited by 0
- 2026Search Shapes Conclusions: Auditing Evidence Selection Bias in Deep Research Agentscited by 0
- 2026Search Shapes Conclusions: Auditing Evidence Selection Bias in Deep Research Agents30 Sep 2026
- 2026Efficient Sequential Evaluation of Large Language Models19 Jul 2026
- 2026Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation30 Jun 2026
- 2026Adaptive Experimentation for Censored Survival Outcomes18 May 2026
- 2026What Do We Care About in Bandits with Noncompliance? BRACE: Bandits with Recommendations, Abstention, and Certified Effects10 Mar 2026
- 2026Observationally Informed Adaptive Causal Experimental Design4 Mar 2026
- 2026Fixed-Horizon Self-Normalized Inference for Adaptive Experiments via Martingale AIPW/DML with Logged Propensities17 Feb 2026
- 2025Minimax and Bayes Optimal Adaptive Experimental Design for Treatment Choice9 Dec 2025
- 2025Design Stability in Adaptive Experiments: Implications for Treatment Effect Estimation25 Oct 2025
- 2025Causal-EPIG: A Prediction-Oriented Active Learning Framework for CATE Estimation26 Sep 2025
- 2025Adaptive Off-Policy Inference for M-Estimators Under Model Misspecification17 Sep 2025
- 2025Multi-Metric Adaptive Experimental Design Under a Fixed Budget with Validation3 Jun 2025
11 more
- 2025Efficient Adaptive Experimentation with Noncompliance23 May 2025
- 2025Optimistic Algorithms for Adaptive Estimation of the Average Treatment Effect7 Feb 2025
- 2025On Pareto Optimality for Parametric Choice Bandits31 Jan 2025
- 2024Logarithmic Neyman Regret for Adaptive Estimation of the Average Treatment Effect21 Nov 2024
- 2024Off-policy estimation with adaptively collected data: the power of online learning19 Nov 2024
- 2024Online Data Collection for Efficient Semiparametric Inference5 Nov 2024
- 2024Active, anytime-valid risk controlling prediction sets15 Jun 2024
- 2024Generalized Neyman Allocation for Locally Minimax Optimal Best-Arm Identification29 May 2024
- 2024Active Adaptive Experimental Design for Treatment Effect Estimation with Covariate Choices6 Mar 2024
- 2024Active Statistical Inference5 Mar 2024
- 2024Adaptive Experimental Design for Policy Learning8 Jan 2024
- 2024Active Statistical Inferencecited by 50
- 2024Active, anytime-valid risk controlling prediction setscited by 14
- 2024Active Adaptive Experimental Design for Treatment Effect Estimation with Covariate Choicescited by 12
- 2025Adaptive Off-Policy Inference for M-Estimators Under Model Misspecificationcited by 4
- 2026Efficient Sequential Evaluation of Large Language Modelscited by 4
- 2024Off-policy estimation with adaptively collected data: the power of online learningcited by 3
- 2024Adaptive Experimental Design for Policy Learningcited by 2
- 2025Optimistic Algorithms for Adaptive Estimation of the Average Treatment Effectcited by 2
- 2025Efficient Adaptive Experimentation with Noncompliancecited by 2
- 2025Causal-EPIG: A Prediction-Oriented Active Learning Framework for CATE Estimationcited by 2
- 2024Generalized Neyman Allocation for Locally Minimax Optimal Best-Arm Identificationcited by 1
- 2025Multi-Metric Adaptive Experimental Design Under a Fixed Budget with Validationcited by 1
12 most cited of 21 All 21 (JSON)
- 2026Efficient Sequential Evaluation of Large Language Models19 Jul 2026
- 2026Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation30 Jun 2026
- 2026Adaptive Experimentation for Censored Survival Outcomes18 May 2026
- 2026What Do We Care About in Bandits with Noncompliance? BRACE: Bandits with Recommendations, Abstention, and Certified Effects10 Mar 2026
- 2026Observationally Informed Adaptive Causal Experimental Design4 Mar 2026
- 2026Fixed-Horizon Self-Normalized Inference for Adaptive Experiments via Martingale AIPW/DML with Logged Propensities17 Feb 2026
- 2025Minimax and Bayes Optimal Adaptive Experimental Design for Treatment Choice9 Dec 2025
- 2025Design Stability in Adaptive Experiments: Implications for Treatment Effect Estimation25 Oct 2025
- 2025Causal-EPIG: A Prediction-Oriented Active Learning Framework for CATE Estimation26 Sep 2025
- 2025Adaptive Off-Policy Inference for M-Estimators Under Model Misspecification17 Sep 2025
- 2025Multi-Metric Adaptive Experimental Design Under a Fixed Budget with Validation3 Jun 2025
- 2025Efficient Adaptive Experimentation with Noncompliance23 May 2025
12 newest of 21 All 21 (JSON)