Observationally Informed Adaptive Causal Experimental Design
Not on the map. Why?
Abstract (arXiv)
Randomized Controlled Trials (RCTs) represent the gold standard for causal inference yet remain a scarce resource. While large-scale observational data is often available, it is utilized only for retrospective fusion, and remains discarded in prospective trial design due to bias concerns. We argue this "tabula rasa" data acquisition strategy is fundamentally inefficient. In this work, we propose Active Residual Learning, a new paradigm that leverages the observational model as a foundational prior. This approach shifts the experimental focus from learning target causal quantities from scratch to efficiently estimating the residuals required to correct observational bias. To operationalize this, we introduce the R-Design framework. Theoretically, we establish two key advantages: (1) a structural efficiency gap, proving that estimating smooth residual contrasts admits strictly faster convergence rates than reconstructing full outcomes; and (2) information efficiency, where we quantify the redundancy in standard parameter-based acquisition (e.g., BALD), demonstrating that such baselines waste budget on task-irrelevant nuisance uncertainty. We propose R-EPIG (Residual Expected Predictive Information Gain), a unified criterion that directly targets the causal estimand, minimizing residual uncertainty for estimation or clarifying decision boundaries for policy. Experiments on synthetic and semi-synthetic benchmarks demonstrate that R-Design significantly outperforms baselines, confirming that repairing a biased model is far more efficient than learning one from scratch.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 48 of its 76 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
48 of 76 references.
References · 48
- 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
- 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
- 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 475
- 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 328
- 2017Bayesian Inference of Individualized Treatment Effects using Multi-task Gaussian Processescited by 156
- 2021Nonparametric Estimation of Heterogeneous Treatment Effects: From Theory to Learning Algorithmscited by 144
- 2025TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Modelscited by 115
- 2021Discussion on "Bayesian Regression Tree Models for Causal Inference: Regularization, Confounding, and Heterogeneous Effects" by Hahn, Murray and Carvalhocited by 77
- 2024Causal machine learning for predicting treatment outcomescited by 73
- 2018Removing Hidden Confounding by Experimental Groundingcited by 64
- 2023Prediction-Oriented Bayesian Active Learningcited by 60
- 2019Estimating Treatment Effects with Causal Forests: An Applicationcited by 58
36 more
- 2020Causal inference methods for combining randomized trials and observational studies: a reviewcited by 50
- 2022A Framework and Benchmark for Deep Batch Active Learning for Regressioncited by 47
- 2022Causal Inference in Recommender Systems: A Survey and Future Directionscited by 44
- 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learningcited by 43
- 2021A Review of Generalizability and Transportabilitycited by 36
- 2021Stochastic Batch Acquisition: A Simple Baseline for Deep Active Learningcited by 36
- 2022Active Bayesian Causal Inferencecited by 34
- 2022Combining Observational and Randomized Data for Estimating Heterogeneous Treatment Effectscited by 32
- 2021Causal-BALD: Deep Bayesian Active Learning of Outcomes to Infer Treatment-Effects from Observational Datacited by 27
- 2021Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matterscited by 25
- 2023Semiparametric Efficient Inference in Adaptive Experimentscited by 23
- 2020Efficient Adaptive Experimental Design for Average Treatment Effect Estimationcited by 22
- 2024Transductive Active Learning: Theory and Applicationscited by 22
- 2019Active Learning for Decision-Making from Imbalanced Observational Datacited by 16
- 2018Stratification Trees for Adaptive Randomization in Randomized Controlled Trialscited by 14
- 2019Balancing Covariates in Randomized Experiments with the Gram-Schmidt Walk Designcited by 13
- 2021Targeted Active Learning for Bayesian Decision-Makingcited by 12
- 2023Black-Box Batch Active Learning for Regressioncited by 12
- 2024Active Adaptive Experimental Design for Treatment Effect Estimation with Covariate Choicescited by 12
- 2023A First Course in Causal Inferencecited by 11
- 2025TabPFN: One Model to Rule Them All?cited by 10
- 2020Data fusion methods for the heterogeneity of treatment effect and confounding functioncited by 9
- 2022Stochastic Tree Ensembles for Estimating Heterogeneous Effectscited by 7
- 2022Sample Constrained Treatment Effect Estimationcited by 7
- 2023Estimating Causal Effects using a Multi-task Deep Ensemblecited by 7
- 2024An Overview of Causal Inference using Kernel Embeddingscited by 5
- 2025The Hardness of Validating Observational Studies with Experimental Datacited by 4
- 2021Designing Experiments Informed by Observational Studiescited by 3
- 2023ACE: Active Learning for Causal Inference with Expensive Experimentscited by 3
- 2025Towards Regulatory-Confirmed Adaptive Clinical Trials: Machine Learning Opportunities and Solutionscited by 3
- 2025Enhancing Treatment Effect Estimation via Active Learning: A Counterfactual Covering Perspectivecited by 3
- 2024Is merging worth it? Securely evaluating the information gain for causal dataset acquisitioncited by 2
- 2024ABC3: Active Bayesian Causal Inference with Cohn Criteria in Randomized Experimentscited by 2
- 2025Causal-EPIG: A Prediction-Oriented Active Learning Framework for CATE Estimationcited by 2
- 2025Learning What to Learn: Experimental Design when Combining Experimental with Observational Evidencecited by 2
- 2025ActiveCQ: Active Estimation of Causal Quantitiescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.