mlsanityData to 7 Oct 2026

Zero-shot causal learning

arXiv 2301.12292 ↗First posted 28 Jan 2023cs.LG cs.AI cs.CYcited by 17

Not on the map. Why?

Abstract (arXiv)

Predicting how different interventions will causally affect a specific individual is important in a variety of domains such as personalized medicine, public policy, and online marketing. There are a large number of methods to predict the effect of an existing intervention based on historical data from individuals who received it. However, in many settings it is important to predict the effects of novel interventions (e.g., a newly invented drug), which these methods do not address. Here, we consider zero-shot causal learning: predicting the personalized effects of a novel intervention. We propose CaML, a causal meta-learning framework which formulates the personalized prediction of each intervention's effect as a task. CaML trains a single meta-model across thousands of tasks, each constructed by sampling an intervention, its recipients, and its nonrecipients. By leveraging both intervention information (e.g., a drug's attributes) and individual features~(e.g., a patient's history), CaML is able to predict the personalized effects of novel interventions that do not exist at the time of training. Experimental results on real world datasets in large-scale medical claims and cell-line perturbations demonstrate the effectiveness of our approach. Most strikingly, method's zero-shot predictions outperform even strong baselines trained directly on data from the test interventions.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 36 of its 112 references that are in the map. First posted on arXiv 28 Jan 2023.

Builds on

36 of 112 references.

References · 36

  1. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  2. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
  3. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  4. 2020Meta-Learning in Neural Networks: A Surveycited by 944
  5. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  6. 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
  7. 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
  8. 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 475
  9. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
  10. 2019Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLcited by 359
  11. 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 328
  12. 2016Learning Representations for Counterfactual Inferencecited by 327
24 more
  1. 2019Adapting Neural Networks for the Estimation of Treatment Effectscited by 285
  2. 2015Recursive Partitioning for Heterogeneous Causal Effectscited by 254
  3. 2017Zero-Shot Learning -- The Good, the Bad and the Uglycited by 254
  4. 2018Modeling polypharmacy side effects with graph convolutional networkscited by 237
  5. 2022LinkBERT: Pretraining Language Models with Document Linkscited by 209
  6. 2017Bayesian Inference of Individualized Treatment Effects using Multi-task Gaussian Processescited by 156
  7. 2021Nonparametric Estimation of Heterogeneous Treatment Effects: From Theory to Learning Algorithmscited by 144
  8. 2018The Blessings of Multiple Causescited by 103
  9. 2018The Measure and Mismeasure of Fairnesscited by 94
  10. 2021Graph Representation Learning in Biomedicinecited by 79
  11. 2021On Inductive Biases for Heterogeneous Treatment Effect Estimationcited by 74
  12. 2021Causal Effect Inference for Structured Treatmentscited by 38
  13. 2022Causal Conceptions of Fairness and their Consequencescited by 38
  14. 2017Generating Visual Representations for Zero-Shot Classificationcited by 37
  15. 2018Benchmarking Framework for Performance-Evaluation of Causal Inference Analysiscited by 33
  16. 2021Evaluating Treatment Prioritization Rules via Rank-Weighted Average Treatment Effectscited by 29
  17. 2020GraphITE: Estimating Individual Effects of Graph-structured Treatmentscited by 18
  18. 2022Estimating individual treatment effects under unobserved confounding using binary instrumentscited by 17
  19. 2020Adjusting for Confounders with Text: Challenges and an Empirical Evaluation Framework for Causal Inferencecited by 13
  20. 2022TripleRE: Knowledge Graph Embeddings via Tripled Relation Vectorscited by 10
  21. 2019MetaCI: Meta-Learning for Causal Inference in a Heterogeneous Populationcited by 6
  22. 2021Doing Great at Estimating CATE? On the Neglected Assumptions in Benchmark Comparisons of Treatment Effect Estimatorscited by 4
  23. 2021Meta-Analysis of Randomized Experiments with Applications to Heavy-Tailed Response Datacited by 4
  24. 2022Heterogeneous Treatment Effect with Trained Kernels of the Nadaraya-Watson Regressioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 2; 2025: 8; 2026: 5.

17 papers.

Sort:

  1. 2025Do-PFN: In-Context Learning for Causal Effect Estimationcited by 46
  2. 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learningcited by 43
  3. 2025Foundation Models for Causal Inference via Prior-Data Fitted Networkscited by 30
  4. 2023Towards Causal Foundation Model: on Duality between Causal Inference and Attentioncited by 17
  5. 2023Dynamic Inter-treatment Information Sharing for Individualized Treatment Effects Estimationcited by 11
  6. 2024Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Developmentcited by 5
  7. 2024Amortized Inference of Causal Models via Conditional Fixed-Point Iterationscited by 4
  8. 2026FoundCause: Causal Discovery with Latent Confounders from Observational Datacited by 3
  9. 2025KANITE: Kolmogorov-Arnold Networks for ITE estimationcited by 2
  10. 2025ACTIVA: Amortized Causal Effect Estimation via Transformer-based Variational Autoencodercited by 1
  11. 2025Doubly Robust Fusion of Many Treatments for Policy Learningcited by 1
  12. 2025Causality in the human niche: lessons for machine learningcited by 1
5 more
  1. 2025Language modelling techniques for analysing the impact of human genetic variationcited by 0
  2. 2026Time Series Causal Discovery via Context-Conditioned and Causality-Augmented Pretrainingcited by 0
  3. 2026Position: Medical AI Neglects Real Treatment Outcomescited by 0
  4. 2026Causal Foundation Modelscited by 0
  5. 2026Representation Learning for Sample-Efficient CATE Estimation by Leveraging Multiple Outcomescited by 0