No-harm calibration for generalized Oaxaca-Blinder estimators
Not on the map. Why?
Abstract (arXiv)
In randomized experiments, adjusting for observed features when estimating treatment effects has been proposed as a way to improve asymptotic efficiency. However, only linear regression has been proven to form an estimate of the average treatment effect that is asymptotically no less efficient than the treated-minus-control difference in means regardless of the true data generating process. Randomized treatment assignment provides this "do-no-harm" property, with neither truth of a linear model nor a generative model for the outcomes being required. We present a general calibration method which confers the same no-harm property onto estimators leveraging a broad class of nonlinear models. This recovers the usual regression-adjusted estimator when ordinary least squares is used, and further provides non-inferior treatment effect estimators using methods such as logistic and Poisson regression. The resulting estimators are non-inferior to both the difference in means estimator and to treatment effect estimators that have not undergone calibration. We show that our estimator is asymptotically equivalent to an inverse probability weighted estimator using a logit link with predicted potential outcomes as covariates. In a simulation study, we demonstrate that common nonlinear estimators without our calibration procedure may perform markedly worse than both the calibrated estimator and the unadjusted difference in means.
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). First posted on arXiv 16 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 0; 2024: 1; 2025: 0; 2026: 2.
4 papers.
- 2021Machine Learning for Variance Reduction in Online Experimentscited by 17
- 2024Variance reduction combining pre-experiment and in-experiment datacited by 2
- 2026MEC: Machine-Learning-Assisted Generalized Entropy Calibration for Semi-Supervised Mean Estimationcited by 0
- 2026Fit CATE Once: Model-Assisted Randomization Tests Without Sample Splittingcited by 0
- 2026Fit CATE Once: Model-Assisted Randomization Tests Without Sample Splitting9 May 2026
- 2026MEC: Machine-Learning-Assisted Generalized Entropy Calibration for Semi-Supervised Mean Estimation7 Apr 2026
- 2024Variance reduction combining pre-experiment and in-experiment data11 Oct 2024
- 2021Machine Learning for Variance Reduction in Online Experiments14 Jun 2021