PPI is the Difference Estimator: Recognizing the Survey Sampling Roots of Prediction-Powered Inference
Not on the map. Why?
Abstract (arXiv)
Prediction-powered inference (PPI) is a rapidly growing framework for combining machine learning predictions with a small set of gold-standard labels to conduct valid statistical inference. In this article, I argue that the core estimators underlying PPI are equivalent to well-established estimators from the survey sampling literature dating back to the 1970s. Specifically, the PPI estimator for a population mean is algebraically equivalent to the difference estimator of Cassel et al. (1976), and PPI plus corresponds to the generalized regression (GREG) estimator of Sarndal et al. (2003). Recognizing this equivalence, I consider what part of PPI is inherited from a long-standing literature in statistics, what part is genuinely new, and where inferential claims require care. After introducing the two frameworks and establishing their equivalence, I break down where PPI diverges from model-assisted estimation, including differences in the mode of inference, the role of the unlabeled data pool, and the consequences of differential prediction error for subgroup estimands such as the average treatment effect. I then identify what each framework offers the other: PPI researchers can draw on the survey sampling literature's well-developed theory of calibration, optimal allocation, and design-based diagnostics, while survey sampling researchers can benefit from PPI's extensions to non-standard estimands and its accessible software ecosystem. The article closes with a call for integration between these two communities, motivated by the growing use of large language models as measurement instruments in applied research.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 6 of its 26 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
6 of 26 references.
References · 6
- 2023Prediction-Powered Inferencecited by 214
- 2023PPI++: Efficient Prediction-Powered Inferencecited by 103
- 2023Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Modelscited by 37
- 2023More power to you: Using machine learning to augment human coding for more efficient inference in text-based randomized trialscited by 4
- 2026Stratified Sampling for Model-Assisted Estimation with Surrogate Outcomescited by 2
- 2023Optimal allocation of sample size for randomization-based inference from 2K factorial designscited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Prediction-Powered Inference Across Many Tasks for AI Evaluation & Social Science Researchcited by 3
- 2026Allocating Human Oversight in AI-Enabled Analyticscited by 1
- 2026Beyond the Training Distribution: Evaluating Predictions Under Distribution Shift and Selection Biascited by 1
- 2026proxymate: Diagnosis and Adjustment of Proxy Estimates for Reliable Inferencecited by 0
- 2026Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluationcited by 0
- 2026Cluster-Robust Prediction-Powered Inferencecited by 0
- 2026Cluster-Robust Prediction-Powered Inference7 Oct 2026
- 2026Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluation17 Sep 2026
- 2026proxymate: Diagnosis and Adjustment of Proxy Estimates for Reliable Inference27 Jul 2026
- 2026Beyond the Training Distribution: Evaluating Predictions Under Distribution Shift and Selection Bias12 Jun 2026
- 2026Prediction-Powered Inference Across Many Tasks for AI Evaluation & Social Science Research28 May 2026
- 2026Allocating Human Oversight in AI-Enabled Analytics14 Apr 2026