Removing Hidden Confounding by Experimental Grounding
Not on the map. Why?
Abstract (arXiv)
Observational data is increasingly used as a means for making individual-level causal predictions and intervention recommendations. The foremost challenge of causal inference from observational data is hidden confounding, whose presence cannot be tested in data and can invalidate any causal conclusion. Experimental data does not suffer from confounding but is usually limited in both scope and scale. We introduce a novel method of using limited experimental data to correct the hidden confounding in causal effect models trained on larger observational data, even if the observational data does not fully overlap with the experimental data. Our method makes strictly weaker assumptions than existing approaches, and we prove conditions under which it yields a consistent estimator. We demonstrate our method's efficacy using real-world data from a large educational experiment.
Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 6; 2023: 9; 2024: 11; 2025: 17; 2026: 8.
64 papers.
Sort:
By area:
- 2024Causal machine learning for predicting treatment outcomescited by 73
- 2021Causal Reinforcement Learning using Observational and Interventional Datacited by 38
- 2021A Review of Generalizability and Transportabilitycited by 36
- 2022Combining Observational and Randomized Data for Estimating Heterogeneous Treatment Effectscited by 32
- 2022Long-term Causal Inference Under Persistent Confounding via Data Combinationcited by 27
- 2021Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matterscited by 25
- 2022Transfer Learning on Heterogeneous Feature Spaces for Treatment Effects Estimationcited by 21
- 2023Balancing Unobserved Confounding with a Few Unbiased Ratings in Debiased Recommendationscited by 18
- 2024Prediction-powered Generalization of Causal Inferencescited by 14
- 2021Multi-Source Causal Inference Using Control Variatescited by 13
- 2022Detecting hidden confounding in observational data using multiple environmentscited by 13
- 2024Meta-Learners for Partially-Identified Treatment Effects Across Multiple Environmentscited by 11
38 more
- 2022Falsification before Extrapolation in Causal Effect Estimationcited by 10
- 2023When does Privileged Information Explain Away Label Noise?cited by 10
- 2025Efficient Randomized Experiments Using Foundation Modelscited by 10
- 2021Obtaining Causal Information by Merging Datasets with MAXENTcited by 9
- 2023Hidden yet quantifiable: A lower bound for confounding strength using randomized trialscited by 8
- 2023RCT Rejection Sampling for Causal Estimation Evaluationcited by 7
- 2024Adaptive-TMLE for the Average Treatment Effect based on Randomized Controlled Trial Augmented with Real-World Datacited by 7
- 2024Combining Experimental and Historical Data for Policy Evaluationcited by 6
- 2024Constructing Confidence Intervals for Average Treatment Effects from Multiple Datasetscited by 6
- 2022Heterogeneous Treatment Effect with Trained Kernels of the Nadaraya-Watson Regressioncited by 4
- 2023Comparison of Methods that Combine Multiple Randomized Trials to Estimate Heterogeneous Treatment Effectscited by 4
- 2023Multi-Study R-Learner for Estimating Heterogeneous Treatment Effects Across Studies Using Statistical Machine Learningcited by 4
- 2024Causal Inference with Latent Variables: Recent Advances and Future Prospectivescited by 4
- 2025The Hardness of Validating Observational Studies with Experimental Datacited by 4
- 2025Inverse Reinforcement Learning with Just Classification and a Few Regressionscited by 4
- 2023Causal Effect Estimation from Observational and Interventional Data Through Matrix Weighted Linear Estimatorscited by 3
- 2021Conditional Cross-Design Synthesis Estimators for Generalizability in Medicaidcited by 2
- 2024Estimating Heterogeneous Treatment Effects by Combining Weak Instruments and Observational Datacited by 2
- 2025Nonparametric Heterogeneous Long-term Causal Effect Estimation via Data Combinationcited by 2
- 2025Long-term Causal Inference via Modeling Sequential Latent Confoundingcited by 2
- 2025Causal-EPIG: A Prediction-Oriented Active Learning Framework for CATE Estimationcited by 2
- 2021Causal Markov Boundariescited by 1
- 2021Synthesized Difference in Differencescited by 1
- 2021Generalizing Clinical Trials with Convex Hullscited by 1
- 2023Counterfactual Prediction Under Selective Confoundingcited by 1
- 2023Estimating treatment effects from single-arm trials via latent-variable modelingcited by 1
- 2024Combining Incomplete Observational and Randomized Data for Heterogeneous Treatment Effectscited by 1
- 2025Robust estimation of heterogeneous treatment effects in randomized trials leveraging external datacited by 1
- 2025Meta-Router: Bridging Gold-standard and Preference-based Evaluations in Large Language Model Routingcited by 1
- 2026Detecting Unobserved Confounders: A Kernelized Regression Approachcited by 1
- 2026Observationally Informed Adaptive Causal Experimental Designcited by 1
- 2026Improving RCT-Based Treatment Effect Estimation Under Covariate Mismatch via Calibrated Alignmentcited by 1
- 2021Combining Interventional and Observational Data Using Causal Reductionscited by 0
- 2021Quantum causal inference in the presence of hidden common causes: An entropic approachcited by 0
- 2021Learning Pareto-Efficient Decisions with Confidencecited by 0
- 2021ADCB: An Alzheimer's disease benchmark for evaluating observational estimators of causal effectscited by 0
- 2024Benchmarks for Reinforcement Learning with Biased Offline Data and Imperfect Simulatorscited by 0
- 2024Accounting for Missing Covariates in Heterogeneous Treatment Estimationcited by 0
50 most cited of 64 All 64 (JSON)
- 2026A General Framework for Budgeted Threshold Incentives on Request24 Sep 2026
- 2026Bayesian fusion forests for heterogeneous treatment effects on survival from randomised and real-world data31 Jul 2026
- 2026Cross-Head Attention Uplift Network with Inverse Propensity Score under Unobserved Confounding25 Jun 2026
- 2026The Partial Testimony of Logs: Evaluation of Language Model Generation under Confounded Model Choice2 May 2026
- 2026Improving RCT-Based Treatment Effect Estimation Under Covariate Mismatch via Calibrated Alignment19 Mar 2026
- 2026Observationally Informed Adaptive Causal Experimental Design4 Mar 2026
- 2026Testing Effect Homogeneity and Confounding in High-Dimensional Experimental and Observational Studies23 Feb 2026
- 2026Detecting Unobserved Confounders: A Kernelized Regression Approach1 Jan 2026
- 2025Meta-Router: Bridging Gold-standard and Preference-based Evaluations in Large Language Model Routing29 Sep 2025
- 2025Causal-EPIG: A Prediction-Oriented Active Learning Framework for CATE Estimation26 Sep 2025
- 2025Inverse Reinforcement Learning with Just Classification and a Few Regressions25 Sep 2025
- 2025Data Fusion for High-Resolution Estimation20 Aug 2025
38 more
- 2025Peer Effect Estimation in the Presence of Simultaneous Feedback and Unobserved Confounders5 Aug 2025
- 2025Robust estimation of heterogeneous treatment effects in randomized trials leveraging external data4 Jul 2025
- 2025Mitigating Hidden Confounding by Progressive Confounder Imputation via Large Language Models26 Jun 2025
- 2025Conditional Average Treatment Effect Estimation Under Hidden Confounders14 Jun 2025
- 2025Uncovering Bias Mechanisms in Observational Studies1 Jun 2025
- 2025Deconfounded Warm-Start Thompson Sampling with Applications to Precision Medicine22 May 2025
- 2025Transportability without Graphs: A Bayesian Approach to Identifying s-Admissible Backdoor Sets19 May 2025
- 2025A Cautionary Tale on Integrating Studies with Disparate Outcome Measures for Causal Inference16 May 2025
- 2025The Hardness of Validating Observational Studies with Experimental Data19 Mar 2025
- 2025Long-term Causal Inference via Modeling Sequential Latent Confounding26 Feb 2025
- 2025Nonparametric Heterogeneous Long-term Causal Effect Estimation via Data Combination26 Feb 2025
- 2025Efficient Randomized Experiments Using Foundation Models6 Feb 2025
- 2025A Partial Initialization Strategy to Mitigate the Overfitting Problem in CATE Estimation with Hidden Confounding15 Jan 2025
- 2024Constructing Confidence Intervals for Average Treatment Effects from Multiple Datasets16 Dec 2024
- 2024Combining Incomplete Observational and Randomized Data for Heterogeneous Treatment Effects28 Oct 2024
- 2024Accounting for Missing Covariates in Heterogeneous Treatment Estimation21 Oct 2024
- 2024Causal machine learning for predicting treatment outcomes11 Oct 2024
- 2024Benchmarks for Reinforcement Learning with Biased Offline Data and Imperfect Simulators30 Jun 2024
- 2024Causal Inference with Latent Variables: Recent Advances and Future Prospectives20 Jun 2024
- 2024Estimating Heterogeneous Treatment Effects by Combining Weak Instruments and Observational Data10 Jun 2024
- 2024Prediction-powered Generalization of Causal Inferences5 Jun 2024
- 2024Meta-Learners for Partially-Identified Treatment Effects Across Multiple Environments4 Jun 2024
- 2024Combining Experimental and Historical Data for Policy Evaluation1 Jun 2024
- 2024Adaptive-TMLE for the Average Treatment Effect based on Randomized Controlled Trial Augmented with Real-World Data12 May 2024
- 2023Hidden yet quantifiable: A lower bound for confounding strength using randomized trials6 Dec 2023
- 2023Estimating treatment effects from single-arm trials via latent-variable modeling6 Nov 2023
- 2023Counterfactual Prediction Under Selective Confounding21 Oct 2023
- 2023RCT Rejection Sampling for Causal Estimation Evaluation27 Jul 2023
- 2023Causal Effect Estimation from Observational and Interventional Data Through Matrix Weighted Linear Estimators9 Jun 2023
- 2023Multi-Study R-Learner for Estimating Heterogeneous Treatment Effects Across Studies Using Statistical Machine Learning1 Jun 2023
- 2023Balancing Unobserved Confounding with a Few Unbiased Ratings in Debiased Recommendations17 Apr 2023
- 2023Comparison of Methods that Combine Multiple Randomized Trials to Estimate Heterogeneous Treatment Effects28 Mar 2023
- 2023When does Privileged Information Explain Away Label Noise?3 Mar 2023
- 2022Transfer Learning on Heterogeneous Feature Spaces for Treatment Effects Estimation8 Oct 2022
- 2022Falsification before Extrapolation in Causal Effect Estimation27 Sep 2022
- 2022Heterogeneous Treatment Effect with Trained Kernels of the Nadaraya-Watson Regression19 Jul 2022
- 2022Detecting hidden confounding in observational data using multiple environments27 May 2022
- 2022Combining Observational and Randomized Data for Estimating Heterogeneous Treatment Effects25 Feb 2022
50 newest of 64 All 64 (JSON)
- 2024Causal machine learning for predicting treatment outcomescited by 73
- 2021Causal Reinforcement Learning using Observational and Interventional Datacited by 38
- 2021A Review of Generalizability and Transportabilitycited by 36
- 2022Combining Observational and Randomized Data for Estimating Heterogeneous Treatment Effectscited by 32
- 2022Long-term Causal Inference Under Persistent Confounding via Data Combinationcited by 27
- 2021Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matterscited by 25
- 2022Transfer Learning on Heterogeneous Feature Spaces for Treatment Effects Estimationcited by 21
- 2023Balancing Unobserved Confounding with a Few Unbiased Ratings in Debiased Recommendationscited by 18
- 2024Prediction-powered Generalization of Causal Inferencescited by 14
- 2021Multi-Source Causal Inference Using Control Variatescited by 13
- 2022Detecting hidden confounding in observational data using multiple environmentscited by 13
- 2024Meta-Learners for Partially-Identified Treatment Effects Across Multiple Environmentscited by 11
12 most cited of 62 All 62 (JSON)
- 2026A General Framework for Budgeted Threshold Incentives on Request24 Sep 2026
- 2026Bayesian fusion forests for heterogeneous treatment effects on survival from randomised and real-world data31 Jul 2026
- 2026Cross-Head Attention Uplift Network with Inverse Propensity Score under Unobserved Confounding25 Jun 2026
- 2026The Partial Testimony of Logs: Evaluation of Language Model Generation under Confounded Model Choice2 May 2026
- 2026Improving RCT-Based Treatment Effect Estimation Under Covariate Mismatch via Calibrated Alignment19 Mar 2026
- 2026Observationally Informed Adaptive Causal Experimental Design4 Mar 2026
- 2026Testing Effect Homogeneity and Confounding in High-Dimensional Experimental and Observational Studies23 Feb 2026
- 2026Detecting Unobserved Confounders: A Kernelized Regression Approach1 Jan 2026
- 2025Meta-Router: Bridging Gold-standard and Preference-based Evaluations in Large Language Model Routing29 Sep 2025
- 2025Causal-EPIG: A Prediction-Oriented Active Learning Framework for CATE Estimation26 Sep 2025
- 2025Data Fusion for High-Resolution Estimation20 Aug 2025
- 2025Peer Effect Estimation in the Presence of Simultaneous Feedback and Unobserved Confounders5 Aug 2025
12 newest of 62 All 62 (JSON)