Debiasing Machine Learning Predictions for Causal Inference Without Additional Ground Truth Data: "One Map, Many Trials" in Satellite-Driven Poverty Analysis
Not on the map. Why?
Abstract (arXiv)
Machine learning models trained on Earth observation data, such as satellite imagery, have demonstrated significant promise in predicting household-level wealth indices, enabling the creation of high-resolution wealth maps that can be leveraged across multiple causal trials while addressing chronic data scarcity in global development research. However, because standard training objectives prioritize overall predictive accuracy, these predictions often suffer from shrinkage toward the mean, leading to attenuated estimates of causal treatment effects and limiting their utility in policy evaluations. Existing debiasing methods, such as Prediction-Powered Inference (PPI), can handle this attenuation bias but require additional fresh ground-truth data at the downstream stage of causal inference, which restricts their applicability in data-scarce environments. We introduce and evaluate two post-hoc correction methods -- Linear Calibration Correction (LCC) and a Tweedie's correction approach -- that substantially reduce shrinkage-induced prediction bias without relying on newly collected labeled data. LCC applies a simple linear transformation estimated on a held-out calibration split; Tweedie's method locally de-shrink predictions using density score estimates and a noise scale learned upstream. We provide practical diagnostics for when a correction is warranted and discuss practical limitations. Across analytical results, simulations, and experiments with Demographic and Health Surveys (DHS) data, both approaches reduce attenuation; Tweedie's correction yields nearly unbiased treatment-effect estimates, enabling a "one map, many trials" paradigm. Although we demonstrate on EO-ML wealth mapping, the methods are not geospatial-specific: they apply to any setting where imputed outcomes are reused downstream (e.g., pollution indices, population density, or LLM-derived indicators).
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 15 of its 35 references that are in the map. First posted on arXiv 2 Aug 2025.
Builds on
15 of 35 references.
References · 15
- 2023Prediction-Powered Inferencecited by 218
- 2020Using satellite imagery to understand and promote sustainable developmentcited by 71
- 2023SSL4EO-L: Datasets and Foundation Models for Landsat Imagerycited by 49
- 2023Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Modelscited by 38
- 2021Micro-Estimates of Wealth for all Low- and Middle-Income Countriescited by 25
- 2022Image-based Treatment Effect Heterogeneitycited by 20
- 2020Statistical modeling: the three culturescited by 18
- 2022Conceptualizing Treatment Leakage in Text-based Causal Inferencecited by 14
- 2021Using Satellite Imagery and Machine Learning to Estimate the Livelihood Impact of Electricity Accesscited by 13
- 2023Integrating Earth Observation Data into Causal Inference: Challenges and Opportunitiescited by 8
- 2025Benchmarking Debiasing Methods for LLM-based Parameter Estimatescited by 6
- 2024A Scoping Review of Earth Observation and Machine Learning for Causal Inference: Implications for the Geography of Povertycited by 5
3 more
- 2024Regression coefficient estimation from remote sensing mapscited by 5
- 2024Optimizing Multi-Scale Representations to Detect Effect Heterogeneity Using Earth Observation and Computer Vision: Applications to Two Anti-Poverty RCTscited by 4
- 2024A High Resolution Urban and Rural Settlement Map of Africa Using Deep Learning and Satellite Imagerycited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.