Zero-shot causal learning
Not on the map. Why?
Abstract (arXiv)
Predicting how different interventions will causally affect a specific individual is important in a variety of domains such as personalized medicine, public policy, and online marketing. There are a large number of methods to predict the effect of an existing intervention based on historical data from individuals who received it. However, in many settings it is important to predict the effects of novel interventions (e.g., a newly invented drug), which these methods do not address. Here, we consider zero-shot causal learning: predicting the personalized effects of a novel intervention. We propose CaML, a causal meta-learning framework which formulates the personalized prediction of each intervention's effect as a task. CaML trains a single meta-model across thousands of tasks, each constructed by sampling an intervention, its recipients, and its nonrecipients. By leveraging both intervention information (e.g., a drug's attributes) and individual features~(e.g., a patient's history), CaML is able to predict the personalized effects of novel interventions that do not exist at the time of training. Experimental results on real world datasets in large-scale medical claims and cell-line perturbations demonstrate the effectiveness of our approach. Most strikingly, method's zero-shot predictions outperform even strong baselines trained directly on data from the test interventions.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 36 of its 112 references that are in the map. First posted on arXiv 28 Jan 2023.
Builds on
36 of 112 references.
References · 36
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2018On First-Order Meta-Learning Algorithmscited by 1,003
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
- 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
- 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
- 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 475
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
- 2019Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLcited by 359
- 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 328
- 2016Learning Representations for Counterfactual Inferencecited by 327
24 more
- 2019Adapting Neural Networks for the Estimation of Treatment Effectscited by 285
- 2015Recursive Partitioning for Heterogeneous Causal Effectscited by 254
- 2017Zero-Shot Learning -- The Good, the Bad and the Uglycited by 254
- 2018Modeling polypharmacy side effects with graph convolutional networkscited by 237
- 2022LinkBERT: Pretraining Language Models with Document Linkscited by 209
- 2017Bayesian Inference of Individualized Treatment Effects using Multi-task Gaussian Processescited by 156
- 2021Nonparametric Estimation of Heterogeneous Treatment Effects: From Theory to Learning Algorithmscited by 144
- 2018The Blessings of Multiple Causescited by 103
- 2018The Measure and Mismeasure of Fairnesscited by 94
- 2021Graph Representation Learning in Biomedicinecited by 79
- 2021On Inductive Biases for Heterogeneous Treatment Effect Estimationcited by 74
- 2021Causal Effect Inference for Structured Treatmentscited by 38
- 2022Causal Conceptions of Fairness and their Consequencescited by 38
- 2017Generating Visual Representations for Zero-Shot Classificationcited by 37
- 2018Benchmarking Framework for Performance-Evaluation of Causal Inference Analysiscited by 33
- 2021Evaluating Treatment Prioritization Rules via Rank-Weighted Average Treatment Effectscited by 29
- 2020GraphITE: Estimating Individual Effects of Graph-structured Treatmentscited by 18
- 2022Estimating individual treatment effects under unobserved confounding using binary instrumentscited by 17
- 2020Adjusting for Confounders with Text: Challenges and an Empirical Evaluation Framework for Causal Inferencecited by 13
- 2022TripleRE: Knowledge Graph Embeddings via Tripled Relation Vectorscited by 10
- 2019MetaCI: Meta-Learning for Causal Inference in a Heterogeneous Populationcited by 6
- 2021Doing Great at Estimating CATE? On the Neglected Assumptions in Benchmark Comparisons of Treatment Effect Estimatorscited by 4
- 2021Meta-Analysis of Randomized Experiments with Applications to Heavy-Tailed Response Datacited by 4
- 2022Heterogeneous Treatment Effect with Trained Kernels of the Nadaraya-Watson Regressioncited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 8; 2026: 5.
17 papers.
Sort:
- 2025Do-PFN: In-Context Learning for Causal Effect Estimationcited by 46
- 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learningcited by 43
- 2025Foundation Models for Causal Inference via Prior-Data Fitted Networkscited by 30
- 2023Towards Causal Foundation Model: on Duality between Causal Inference and Attentioncited by 17
- 2023Dynamic Inter-treatment Information Sharing for Individualized Treatment Effects Estimationcited by 11
- 2024Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Developmentcited by 5
- 2024Amortized Inference of Causal Models via Conditional Fixed-Point Iterationscited by 4
- 2026FoundCause: Causal Discovery with Latent Confounders from Observational Datacited by 3
- 2025KANITE: Kolmogorov-Arnold Networks for ITE estimationcited by 2
- 2025ACTIVA: Amortized Causal Effect Estimation via Transformer-based Variational Autoencodercited by 1
- 2025Doubly Robust Fusion of Many Treatments for Policy Learningcited by 1
- 2025Causality in the human niche: lessons for machine learningcited by 1
5 more
- 2025Language modelling techniques for analysing the impact of human genetic variationcited by 0
- 2026Time Series Causal Discovery via Context-Conditioned and Causality-Augmented Pretrainingcited by 0
- 2026Position: Medical AI Neglects Real Treatment Outcomescited by 0
- 2026Causal Foundation Modelscited by 0
- 2026Representation Learning for Sample-Efficient CATE Estimation by Leveraging Multiple Outcomescited by 0
- 2026Representation Learning for Sample-Efficient CATE Estimation by Leveraging Multiple Outcomes5 Sep 2026
- 2026Causal Foundation Models2 Sep 2026
- 2026Position: Medical AI Neglects Real Treatment Outcomes28 Jun 2026
- 2026FoundCause: Causal Discovery with Latent Confounders from Observational Data16 Jun 2026
- 2026Time Series Causal Discovery via Context-Conditioned and Causality-Augmented Pretraining26 May 2026
- 2025Causality in the human niche: lessons for machine learning13 Jun 2025
- 2025Foundation Models for Causal Inference via Prior-Data Fitted Networks12 Jun 2025
- 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learning9 Jun 2025
- 2025Do-PFN: In-Context Learning for Causal Effect Estimation6 Jun 2025
- 2025Doubly Robust Fusion of Many Treatments for Policy Learning12 May 2025
- 2025KANITE: Kolmogorov-Arnold Networks for ITE estimation18 Mar 2025
- 2025Language modelling techniques for analysing the impact of human genetic variation7 Mar 2025
5 more
- 2025ACTIVA: Amortized Causal Effect Estimation via Transformer-based Variational Autoencoder3 Mar 2025
- 2024Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Development18 Nov 2024
- 2024Amortized Inference of Causal Models via Conditional Fixed-Point Iterations8 Oct 2024
- 2023Towards Causal Foundation Model: on Duality between Causal Inference and Attention1 Oct 2023
- 2023Dynamic Inter-treatment Information Sharing for Individualized Treatment Effects Estimation25 May 2023
- 2025Do-PFN: In-Context Learning for Causal Effect Estimationcited by 46
- 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learningcited by 43
- 2025Foundation Models for Causal Inference via Prior-Data Fitted Networkscited by 30
- 2023Towards Causal Foundation Model: on Duality between Causal Inference and Attentioncited by 17
- 2023Dynamic Inter-treatment Information Sharing for Individualized Treatment Effects Estimationcited by 11
- 2024Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Developmentcited by 5
- 2024Amortized Inference of Causal Models via Conditional Fixed-Point Iterationscited by 4
- 2026FoundCause: Causal Discovery with Latent Confounders from Observational Datacited by 3
- 2025KANITE: Kolmogorov-Arnold Networks for ITE estimationcited by 2
- 2025ACTIVA: Amortized Causal Effect Estimation via Transformer-based Variational Autoencodercited by 1
- 2025Doubly Robust Fusion of Many Treatments for Policy Learningcited by 1
- 2025Causality in the human niche: lessons for machine learningcited by 1
12 most cited of 17 All 17 (JSON)
- 2026Representation Learning for Sample-Efficient CATE Estimation by Leveraging Multiple Outcomes5 Sep 2026
- 2026Causal Foundation Models2 Sep 2026
- 2026Position: Medical AI Neglects Real Treatment Outcomes28 Jun 2026
- 2026FoundCause: Causal Discovery with Latent Confounders from Observational Data16 Jun 2026
- 2026Time Series Causal Discovery via Context-Conditioned and Causality-Augmented Pretraining26 May 2026
- 2025Causality in the human niche: lessons for machine learning13 Jun 2025
- 2025Foundation Models for Causal Inference via Prior-Data Fitted Networks12 Jun 2025
- 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learning9 Jun 2025
- 2025Do-PFN: In-Context Learning for Causal Effect Estimation6 Jun 2025
- 2025Doubly Robust Fusion of Many Treatments for Policy Learning12 May 2025
- 2025KANITE: Kolmogorov-Arnold Networks for ITE estimation18 Mar 2025
- 2025Language modelling techniques for analysing the impact of human genetic variation7 Mar 2025
12 newest of 17 All 17 (JSON)