PPI++: Efficient Prediction-Powered Inference
Not on the map. Why?
Abstract (arXiv)
We present PPI++: a computationally lightweight methodology for estimation and inference based on a small labeled dataset and a typically much larger dataset of machine-learning predictions. The methods automatically adapt to the quality of available predictions, yielding easy-to-compute confidence sets -- for parameters of any dimensionality -- that always improve on classical intervals using only the labeled data. PPI++ builds on prediction-powered inference (PPI), which targets the same problem setting, improving its computational and statistical efficiency. Real and synthetic experiments demonstrate the benefits of the proposed adaptations.
Key facts. Cited by 103 papers in the map (data through 7 Oct 2026). Builds on 9 of its 33 references that are in the map. First posted on arXiv 2 Nov 2023.
Builds on
9 of 33 references.
References · 9
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2021Convex optimizationcited by 2,479
- 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 443
- 2023Prediction-Powered Inferencecited by 214
- 2019Veridical Data Sciencecited by 65
- 2023Cross-Prediction-Powered Inferencecited by 57
- 2016Semi-supervised Inference: General Theory and Estimation of Meanscited by 38
- 2019High-dimensional semi-supervised learning: in search for optimal inference of the meancited by 8
Built on by
Citing papers per year: 2023: 2; 2024: 16; 2025: 37; 2026: 48.
103 papers.
Sort:
By area:
- 2024AutoEval Done Right: Using Synthetic Data for Model Evaluationcited by 53
- 2024Active Statistical Inferencecited by 46
- 2024Limits to scalable evaluation at the frontier: LLM as Judge won't beat twice the datacited by 46
- 2025Predictions as Surrogates: Revisiting Surrogate Outcomes in the Age of AIcited by 31
- 2024Prediction-Powered Ranking of Large Language Modelscited by 29
- 2025How Benchmark Prediction from Fewer Data Misses the Markcited by 26
- 2023Assumption-Lean and Data-Adaptive Post-Prediction Inferencecited by 25
- 2025How to Correctly Report LLM-as-a-Judge Evaluationscited by 25
- 2024Stratified Prediction-Powered Inference for Hybrid Language Model Evaluationcited by 24
- 2026Noisy but Valid: Robust Statistical Evaluation of LLMs with Imperfect Judgescited by 23
- 2025Prediction-Powered E-Valuescited by 16
- 2025Cost-Optimal Active AI Model Evaluationcited by 14
38 more
- 2023Prediction De-Correlated Inference: A safe approach for post-prediction inferencecited by 13
- 2024A Framework for Efficient Model Evaluation through Stratification, Sampling, and Estimationcited by 13
- 2024Semi-Supervised Risk Control via Prediction-Powered Inferencecited by 13
- 2025Multi-Armed Bandits With Machine Learning-Generated Surrogate Rewardscited by 13
- 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulatorscited by 13
- 2024A Note on the Prediction-Powered Bootstrapcited by 10
- 2025Efficient Randomized Experiments Using Foundation Modelscited by 10
- 2025Prediction-Powered Causal Inferencescited by 9
- 2025Adaptive Prediction-Powered AutoEval with Reliability and Efficiency Guaranteescited by 9
- 2026Multiple-Prediction-Powered Inferencecited by 9
- 2024Task-Agnostic Machine-Learning-Assisted Inferencecited by 8
- 2025No Free Lunch: Non-Asymptotic Analysis of Prediction-Powered Inferencecited by 8
- 2025FAB-PPI: Frequentist, Assisted by Bayes, Prediction-Powered Inferencecited by 7
- 2025Anytime-valid, Bayes-assisted, Prediction-Powered Inferencecited by 7
- 2025Probably Approximately Correct Labelscited by 7
- 2025Valid Inference with Imperfect Synthetic Datacited by 7
- 2025Doubly-Robust LLM-as-a-Judge: Externally Valid Estimation with Imperfect Personascited by 7
- 2026Efficient Inference for Noisy LLM-as-a-Judge Evaluationcited by 7
- 2024Local Prediction-Powered Inferencecited by 6
- 2024Regression for the Mean: Auto-Evaluation and Inference with Few Labels through Post-hoc Regressioncited by 6
- 2024Another look at statistical inference with machine learning-imputed datacited by 6
- 2024Constructing Confidence Intervals for Average Treatment Effects from Multiple Datasetscited by 6
- 2025Accelerating Unbiased LLM Evaluation via Synthetic Feedbackcited by 6
- 2025AI-Powered Bayesian Inferencecited by 6
- 2026PPI is the Difference Estimator: Recognizing the Survey Sampling Roots of Prediction-Powered Inferencecited by 6
- 2025Generalization Bounds and Stopping Rules for Learning with Self-Selected Datacited by 5
- 2025A Unified Framework for Inference with General Missingness Patterns and Machine Learning Imputationcited by 5
- 2025General Synthetic-Powered Inferencecited by 5
- 2025Prediction-Powered Semi-Supervised Learning with Online Power Tuningcited by 5
- 2025Robust Sampling for Active Statistical Inferencecited by 5
- 2025Statistical Inference under Performativitycited by 4
- 2025How can we assess human-agent interactions? Case studies in software agent designcited by 4
- 2026Demystifying Prediction Powered Inferencecited by 4
- 2026A Statistical Framework for Alignment with Biased AI Feedbackcited by 4
- 2024Automatic AI Model Selection for Wireless Systems: Online Learning via Digital Twinningcited by 3
- 2025ACT as Human: Multimodal Large Language Model Data Annotation with Critical Thinkingcited by 3
- 2026PPI-SVRG: Unifying Prediction-Powered Inference and Variance Reduction for Semi-Supervised Optimizationcited by 3
- 2026Revisiting Active Sequential Prediction-Powered Mean Estimationcited by 3
50 most cited of 103 All 103 (JSON)
- 2026Estimating Uncoded Crash Factors with Tabular Foundation and System One Models: Kumo Tabular and Jev7 Oct 2026
- 2026Cluster-Robust Prediction-Powered Inference7 Oct 2026
- 2026OTROPE: Optimal Transport-based Robust Off-policy Evaluation for Large Language Models28 Sep 2026
- 2026ABC-Align: Prediction-Powered Alignment with Adaptive Bias Control28 Sep 2026
- 2026Frozen Judges, Moving Agents: Version-Dependent LLM-Judge Error and the Limits of Judge-Assisted Agent Evaluation28 Sep 2026
- 2026How Synthetic Labels Improve Conformal Prediction: A Perspective on Conditional Coverage27 Sep 2026
- 2026When Can Old Evaluations Certify a New Model? Label-Efficient Release Decisions under Evaluator Drift26 Sep 2026
- 2026Artificial intelligence surrogates for treatment effect estimation with before-and-after data23 Sep 2026
- 2026Augmented Hypothesis Testing with Persona-Based LLM Simulations21 Sep 2026
- 2026Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluation17 Sep 2026
- 2026When Can LLM Digital Twins Reduce Human Measurement? From Behavioral Fidelity to Statistical Substitutability7 Sep 2026
- 2026What Does an LLM-Agent Leaderboard Rank Actually Compare?7 Sep 2026
38 more
- 2026Interpretable AI with Local Distillation24 Aug 2026
- 2026Conditional Evaluation of Language Models with Cheap Auxiliary Signals17 Aug 2026
- 2026Pay Only for Disagreement: Certified No-Regression Verdicts for Model Updates with Matching Label-Complexity Bounds22 Jul 2026
- 2026Scalable Model-Assisted Multi-Target Estimation in Large Image Collections20 Jul 2026
- 2026Beyond Independent Labels: Schwartz-Geometry Decoding for Human Value Detection6 Jul 2026
- 2026BACON: Budgeted Human Calibration for Modeling and Evaluation with Multiple AI Judges26 Jun 2026
- 2026Beyond the Training Distribution: Evaluating Predictions Under Distribution Shift and Selection Bias12 Jun 2026
- 2026Valid Inference with Synthetic Data via Task Exchangeability11 Jun 2026
- 2026Industrializing Prediction-Powered Inference: The GLIDE Library for Reliable GenAI and Agentic Systems Evaluation29 May 2026
- 2026Prediction-Powered Inference Across Many Tasks for AI Evaluation & Social Science Research28 May 2026
- 2026Semi-Supervised Hypothesis Testing by Betting on Predictions27 May 2026
- 2026Learning U-Statistics with Active Inference12 May 2026
- 2026Valid Best-Model Identification for LLM Evaluation via Low-Rank Factorization11 May 2026
- 2026Active Multiple-Prediction-Powered Inference8 May 2026
- 2026Empirical Bayes Rebiasing8 May 2026
- 2026Prediction-powered Inference by Mixture of Experts30 Apr 2026
- 2026Bootstrapping with AI/ML-generated labels26 Apr 2026
- 2026Debiased neural operators for estimating functionals21 Apr 2026
- 2026Revisiting Active Sequential Prediction-Powered Mean Estimation20 Apr 2026
- 2026Generative Augmented Inference of LLM-generated Data for Market Research: Theory and Empirical Evidence16 Apr 2026
- 2026MEC: Machine-Learning-Assisted Generalized Entropy Calibration for Semi-Supervised Mean Estimation7 Apr 2026
- 2026Multiple-Prediction-Powered Inference28 Mar 2026
- 2026PPI is the Difference Estimator: Recognizing the Survey Sampling Roots of Prediction-Powered Inference19 Mar 2026
- 2026Robust LLM Performance Certification via Constrained Maximum Likelihood Estimation11 Mar 2026
- 2026Spatially Robust Inference with Predicted and Missing at Random Labels11 Mar 2026
- 2026Generalized Prediction-Powered Inference, with Application to Binary Classifier Evaluation10 Feb 2026
- 2026A Statistical Framework for Alignment with Biased AI Feedback9 Feb 2026
- 2026Journey to the Centre of Cluster: Harnessing Interior Nodes for A/B Testing under Network Interference4 Feb 2026
- 2026Should I use Synthetic Data for That? An Analysis of the Suitability of Synthetic Data for Data Sharing and Augmentation3 Feb 2026
- 2026Prediction-Powered Risk Monitoring of Deployed Models for Detecting Harmful Distribution Shifts2 Feb 2026
- 2026Dependence-Aware Label Aggregation for LLM-as-a-Judge via Ising Models29 Jan 2026
- 2026PPI-SVRG: Unifying Prediction-Powered Inference and Variance Reduction for Semi-Supervised Optimization29 Jan 2026
- 2026Noisy but Valid: Robust Statistical Evaluation of LLMs with Imperfect Judges28 Jan 2026
- 2026Demystifying Prediction Powered Inference28 Jan 2026
- 2026Efficient Inference for Noisy LLM-as-a-Judge Evaluation8 Jan 2026
- 2026Personalizing black-box models for nonparametric regression with minimax optimality4 Jan 2026
- 2025Do We Really Even Need Data? A Modern Look at Drawing Inference with Predicted Data5 Dec 2025
- 2025Uncertainty Quantification and Data Efficiency in AI: An Information-Theoretic Perspective4 Dec 2025
50 newest of 103 All 103 (JSON)
- 2024AutoEval Done Right: Using Synthetic Data for Model Evaluationcited by 53
- 2025Valid Inference with Imperfect Synthetic Datacited by 7
- 2026Generative Augmented Inference of LLM-generated Data for Market Research: Theory and Empirical Evidencecited by 2
- 2026Valid Inference with Synthetic Data via Task Exchangeabilitycited by 1
- 2026Valid Inference with Synthetic Data via Task Exchangeability11 Jun 2026
- 2026Generative Augmented Inference of LLM-generated Data for Market Research: Theory and Empirical Evidence16 Apr 2026
- 2025Valid Inference with Imperfect Synthetic Data8 Aug 2025
- 2024AutoEval Done Right: Using Synthetic Data for Model Evaluation9 Mar 2024
- 2026Prediction-powered Inference by Mixture of Expertscited by 1
- 2026Prediction-powered Inference by Mixture of Experts30 Apr 2026
- 2024Active Statistical Inferencecited by 46
- 2024Limits to scalable evaluation at the frontier: LLM as Judge won't beat twice the datacited by 46
- 2025Predictions as Surrogates: Revisiting Surrogate Outcomes in the Age of AIcited by 31
- 2024Prediction-Powered Ranking of Large Language Modelscited by 29
- 2025How Benchmark Prediction from Fewer Data Misses the Markcited by 26
- 2023Assumption-Lean and Data-Adaptive Post-Prediction Inferencecited by 25
- 2025How to Correctly Report LLM-as-a-Judge Evaluationscited by 25
- 2024Stratified Prediction-Powered Inference for Hybrid Language Model Evaluationcited by 24
- 2026Noisy but Valid: Robust Statistical Evaluation of LLMs with Imperfect Judgescited by 23
- 2025Prediction-Powered E-Valuescited by 16
- 2025Cost-Optimal Active AI Model Evaluationcited by 14
- 2023Prediction De-Correlated Inference: A safe approach for post-prediction inferencecited by 13
12 most cited of 89 All 89 (JSON)
- 2026Estimating Uncoded Crash Factors with Tabular Foundation and System One Models: Kumo Tabular and Jev7 Oct 2026
- 2026Cluster-Robust Prediction-Powered Inference7 Oct 2026
- 2026OTROPE: Optimal Transport-based Robust Off-policy Evaluation for Large Language Models28 Sep 2026
- 2026Frozen Judges, Moving Agents: Version-Dependent LLM-Judge Error and the Limits of Judge-Assisted Agent Evaluation28 Sep 2026
- 2026How Synthetic Labels Improve Conformal Prediction: A Perspective on Conditional Coverage27 Sep 2026
- 2026When Can Old Evaluations Certify a New Model? Label-Efficient Release Decisions under Evaluator Drift26 Sep 2026
- 2026Artificial intelligence surrogates for treatment effect estimation with before-and-after data23 Sep 2026
- 2026Augmented Hypothesis Testing with Persona-Based LLM Simulations21 Sep 2026
- 2026Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluation17 Sep 2026
- 2026When Can LLM Digital Twins Reduce Human Measurement? From Behavioral Fidelity to Statistical Substitutability7 Sep 2026
- 2026Interpretable AI with Local Distillation24 Aug 2026
- 2026Conditional Evaluation of Language Models with Cheap Auxiliary Signals17 Aug 2026
12 newest of 89 All 89 (JSON)