mlsanityData to 7 Oct 2026

Observationally Informed Adaptive Causal Experimental Design

arXiv 2603.03785 ↗First posted 4 Mar 2026stat.ML cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Randomized Controlled Trials (RCTs) represent the gold standard for causal inference yet remain a scarce resource. While large-scale observational data is often available, it is utilized only for retrospective fusion, and remains discarded in prospective trial design due to bias concerns. We argue this "tabula rasa" data acquisition strategy is fundamentally inefficient. In this work, we propose Active Residual Learning, a new paradigm that leverages the observational model as a foundational prior. This approach shifts the experimental focus from learning target causal quantities from scratch to efficiently estimating the residuals required to correct observational bias. To operationalize this, we introduce the R-Design framework. Theoretically, we establish two key advantages: (1) a structural efficiency gap, proving that estimating smooth residual contrasts admits strictly faster convergence rates than reconstructing full outcomes; and (2) information efficiency, where we quantify the redundancy in standard parameter-based acquisition (e.g., BALD), demonstrating that such baselines waste budget on task-irrelevant nuisance uncertainty. We propose R-EPIG (Residual Expected Predictive Information Gain), a unified criterion that directly targets the causal estimand, minimizing residual uncertainty for estimation or clarifying decision boundaries for policy. Experiments on synthetic and semi-synthetic benchmarks demonstrate that R-Design significantly outperforms baselines, confirming that repairing a biased model is far more efficient than learning one from scratch.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 48 of its 76 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

48 of 76 references.

References · 48

  1. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
  2. 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
  3. 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 475
  4. 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 328
  5. 2017Bayesian Inference of Individualized Treatment Effects using Multi-task Gaussian Processescited by 156
  6. 2021Nonparametric Estimation of Heterogeneous Treatment Effects: From Theory to Learning Algorithmscited by 144
  7. 2025TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Modelscited by 115
  8. 2021Discussion on "Bayesian Regression Tree Models for Causal Inference: Regularization, Confounding, and Heterogeneous Effects" by Hahn, Murray and Carvalhocited by 77
  9. 2024Causal machine learning for predicting treatment outcomescited by 73
  10. 2018Removing Hidden Confounding by Experimental Groundingcited by 64
  11. 2023Prediction-Oriented Bayesian Active Learningcited by 60
  12. 2019Estimating Treatment Effects with Causal Forests: An Applicationcited by 58
36 more
  1. 2020Causal inference methods for combining randomized trials and observational studies: a reviewcited by 50
  2. 2022A Framework and Benchmark for Deep Batch Active Learning for Regressioncited by 47
  3. 2022Causal Inference in Recommender Systems: A Survey and Future Directionscited by 44
  4. 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learningcited by 43
  5. 2021A Review of Generalizability and Transportabilitycited by 36
  6. 2021Stochastic Batch Acquisition: A Simple Baseline for Deep Active Learningcited by 36
  7. 2022Active Bayesian Causal Inferencecited by 34
  8. 2022Combining Observational and Randomized Data for Estimating Heterogeneous Treatment Effectscited by 32
  9. 2021Causal-BALD: Deep Bayesian Active Learning of Outcomes to Infer Treatment-Effects from Observational Datacited by 27
  10. 2021Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matterscited by 25
  11. 2023Semiparametric Efficient Inference in Adaptive Experimentscited by 23
  12. 2020Efficient Adaptive Experimental Design for Average Treatment Effect Estimationcited by 22
  13. 2024Transductive Active Learning: Theory and Applicationscited by 22
  14. 2019Active Learning for Decision-Making from Imbalanced Observational Datacited by 16
  15. 2018Stratification Trees for Adaptive Randomization in Randomized Controlled Trialscited by 14
  16. 2019Balancing Covariates in Randomized Experiments with the Gram-Schmidt Walk Designcited by 13
  17. 2021Targeted Active Learning for Bayesian Decision-Makingcited by 12
  18. 2023Black-Box Batch Active Learning for Regressioncited by 12
  19. 2024Active Adaptive Experimental Design for Treatment Effect Estimation with Covariate Choicescited by 12
  20. 2023A First Course in Causal Inferencecited by 11
  21. 2025TabPFN: One Model to Rule Them All?cited by 10
  22. 2020Data fusion methods for the heterogeneity of treatment effect and confounding functioncited by 9
  23. 2022Stochastic Tree Ensembles for Estimating Heterogeneous Effectscited by 7
  24. 2022Sample Constrained Treatment Effect Estimationcited by 7
  25. 2023Estimating Causal Effects using a Multi-task Deep Ensemblecited by 7
  26. 2024An Overview of Causal Inference using Kernel Embeddingscited by 5
  27. 2025The Hardness of Validating Observational Studies with Experimental Datacited by 4
  28. 2021Designing Experiments Informed by Observational Studiescited by 3
  29. 2023ACE: Active Learning for Causal Inference with Expensive Experimentscited by 3
  30. 2025Towards Regulatory-Confirmed Adaptive Clinical Trials: Machine Learning Opportunities and Solutionscited by 3
  31. 2025Enhancing Treatment Effect Estimation via Active Learning: A Counterfactual Covering Perspectivecited by 3
  32. 2024Is merging worth it? Securely evaluating the information gain for causal dataset acquisitioncited by 2
  33. 2024ABC3: Active Bayesian Causal Inference with Cohn Criteria in Randomized Experimentscited by 2
  34. 2025Causal-EPIG: A Prediction-Oriented Active Learning Framework for CATE Estimationcited by 2
  35. 2025Learning What to Learn: Experimental Design when Combining Experimental with Observational Evidencecited by 2
  36. 2025ActiveCQ: Active Estimation of Causal Quantitiescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.