# Prediction-powered Generalization of Causal Inferences

arXiv: https://arxiv.org/abs/2406.02873 · HTML: https://mlsanity.com/paper/2406.02873/

## Key facts

- Cited by 15 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 36 references that are in the map.
- First posted on arXiv 5 Jun 2024.

## Builds on (most cited first, 24 of 24)

- [Learning Representations for Counterfactual Inference](https://mlsanity.com/paper/1605.03661/) (2016)
- [Prediction-Powered Inference](https://mlsanity.com/paper/2301.09633/) (2023)
- [Removing Hidden Confounding by Experimental Grounding](https://mlsanity.com/paper/1810.11646/) (2018)
- [Causal inference methods for combining randomized trials and observational studies: a review](https://mlsanity.com/paper/2011.08047/) (2020)
- [Combining Observational and Randomized Data for Estimating Heterogeneous Treatment Effects](https://mlsanity.com/paper/2202.12891/) (2022)
- [Combining multiple observational data sources to estimate causal effects](https://mlsanity.com/paper/1801.00802/) (2018)
- [Combining Observational and Experimental Datasets Using Shrinkage Estimators](https://mlsanity.com/paper/2002.06708/) (2020)
- [Generalizing causal inferences from individuals in randomized trials to all trial-eligible individuals](https://mlsanity.com/paper/1709.04589/) (2017)
- [Adaptive Combination of Randomized and Observational Data](https://mlsanity.com/paper/2111.15012/) (2021)
- [Extending inferences from a randomized trial to a new target population](https://mlsanity.com/paper/1805.00550/) (2018)
- [Elastic Integrative Analysis of Randomized Trial and Real-World Data for Treatment Heterogeneity Estimation](https://mlsanity.com/paper/2005.10579/) (2020)
- [Multi-Source Causal Inference Using Control Variates](https://mlsanity.com/paper/2103.16689/) (2021)
- [Detecting hidden confounding in observational data using multiple environments](https://mlsanity.com/paper/2205.13935/) (2022)
- [Multiply Robust Federated Estimation of Targeted Average Treatment Effects](https://mlsanity.com/paper/2309.12600/) (2023)
- [Falsification before Extrapolation in Causal Effect Estimation](https://mlsanity.com/paper/2209.13708/) (2022)
- [Falsification of Internal and External Validity in Observational Studies via Conditional Moment Restrictions](https://mlsanity.com/paper/2301.13133/) (2023)
- [Minimax Rates and Adaptivity in Combining Experimental and Observational Data](https://mlsanity.com/paper/2109.10522/) (2021)
- [Hidden yet quantifiable: A lower bound for confounding strength using randomized trials](https://mlsanity.com/paper/2312.03871/) (2023)
- [Detecting critical treatment effect bias in small subgroups](https://mlsanity.com/paper/2404.18905/) (2024)
- [Prognostic Adjustment with Efficient Estimators to Unbiasedly Leverage Historical Data in Randomized Trials](https://mlsanity.com/paper/2305.19180/) (2023)
- [Understanding the Risks and Rewards of Combining Unbiased and Possibly Biased Estimators, with Applications to Causal Inference](https://mlsanity.com/paper/2205.10467/) (2022)
- [Benchmarking Observational Studies with Experimental Data under Right-Censoring](https://mlsanity.com/paper/2402.15137/) (2024)
- [Designing Experiments Informed by Observational Studies](https://mlsanity.com/paper/2102.10237/) (2021)
- [Conditional Cross-Design Synthesis Estimators for Generalizability in Medicaid](https://mlsanity.com/paper/2109.13288/) (2021)

## Built on by (most cited first, 15 of 15)

- [Efficient Randomized Experiments Using Foundation Models](https://mlsanity.com/paper/2502.04262/) (2025)
- [Prediction-Powered Causal Inferences](https://mlsanity.com/paper/2502.06343/) (2025)
- [Multiple-Prediction-Powered Inference](https://mlsanity.com/paper/2603.27414/) (2026)
- [No Free Lunch: Non-Asymptotic Analysis of Prediction-Powered Inference](https://mlsanity.com/paper/2505.20178/) (2025)
- [Another look at statistical inference with machine learning-imputed data](https://mlsanity.com/paper/2411.19908/) (2024)
- [A Unified Framework for Inference with General Missingness Patterns and Machine Learning Imputation](https://mlsanity.com/paper/2508.15162/) (2025)
- [Constructing Confidence Intervals for Average Treatment Effects from Multiple Datasets](https://mlsanity.com/paper/2412.11511/) (2024)
- [How can we assess human-agent interactions? Case studies in software agent design](https://mlsanity.com/paper/2510.09801/) (2025)
- [Calibeating Prediction-Powered Inference](https://mlsanity.com/paper/2604.21260/) (2026)
- [Do We Really Even Need Data? A Modern Look at Drawing Inference with Predicted Data](https://mlsanity.com/paper/2512.05456/) (2025)
- [Meta-Analysis with Untrusted Data](https://mlsanity.com/paper/2407.09387/) (2024)
- [Semi-Supervised Treatment Effect Estimation with Unlabeled Covariates for Prediction-Powered Causal Inference](https://mlsanity.com/paper/2511.08303/) (2025)
- [Accounting for Missing Covariates in Heterogeneous Treatment Estimation](https://mlsanity.com/paper/2410.15655/) (2024)
- [Uncovering Bias Mechanisms in Observational Studies](https://mlsanity.com/paper/2506.01191/) (2025)
- [Artificial intelligence surrogates for treatment effect estimation with before-and-after data](https://mlsanity.com/paper/2609.27180/) (2026)

## Abstract (arXiv)

Causal inferences from a randomized controlled trial (RCT) may not pertain to a target population where some effect modifiers have a different distribution. Prior work studies generalizing the results of a trial to a target population with no outcome but covariate data available. We show how the limited size of trials makes generalization a statistically infeasible task, as it requires estimating complex nuisance functions. We develop generalization algorithms that supplement the trial data with a prediction model learned from an additional observational study (OS), without making any assumptions on the OS. We theoretically and empirically show that our methods facilitate better generalization when the OS is high-quality, and remain robust when it is not, and e.g., have unmeasured confounding.
