Learned Causal Method Prediction
Not on the map. Why?
Abstract (arXiv)
For a given causal question, it is important to efficiently decide which causal inference method to use for a given dataset. This is challenging because causal methods typically rely on complex and difficult-to-verify assumptions, and cross-validation is not applicable since ground truth causal quantities are unobserved. In this work, we propose CAusal Method Predictor (CAMP), a framework for predicting the best method for a given dataset. To this end, we generate datasets from a diverse set of synthetic causal models, score the candidate methods, and train a model to directly predict the highest-scoring method for that dataset. Next, by formulating a self-supervised pre-training objective centered on dataset assumptions relevant for causal inference, we significantly reduce the need for costly labeled data and enhance training efficiency. Our strategy learns to map implicit dataset properties to the best method in a data-driven manner. In our experiments, we focus on method prediction for causal discovery. CAMP outperforms selecting any individual candidate method and demonstrates promising generalization to unseen semi-synthetic and real-world benchmarks.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 41 of its 71 references that are in the map. First posted on arXiv 7 Nov 2023.
Builds on
41 of 71 references.
References · 41
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,380
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 752
- 2019AutoML: A Survey of the State-of-the-Artcited by 390
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 353
- 2019S4L: Self-Supervised Semi-Supervised Learningcited by 335
- 2019DAG-GNN: DAG Structure Learning with Graph Neural Networkscited by 331
- 2013Causal Discovery with Continuous Additive Noise Modelscited by 255
29 more
- 2019Gradient-Based Neural DAG Learningcited by 227
- 2019Learning Sparse Nonparametric DAGscited by 207
- 2020A Survey on Causal Inferencecited by 202
- 2018Model Evaluation, Model Selection, and Algorithm Selection in Machine Learningcited by 157
- 2023Causal Parrots: Large Language Models May Talk Causality But Are Not Causalcited by 150
- 2022Deep End-to-end Causal Inferencecited by 95
- 2022Amortized Inference for Causal Structure Learningcited by 90
- 2022Learning to Induce Causal Structurecited by 68
- 2023Causal Discovery with Language Models as Imperfect Expertscited by 64
- 2021gCastle: A Python Toolbox for Causal Discoverycited by 61
- 2022On the Identifiability and Estimation of Causal Location-Scale Noise Modelscited by 56
- 2023Understanding Causality with Large Language Models: Feasibility and Opportunitiescited by 53
- 2022Causal Structure Learning: a Combinatorial Perspectivecited by 46
- 2023In Search of Insights, Not Magic Bullets: Towards Demystification of the Model Selection Dilemma in Heterogeneous Treatment Effect Estimationcited by 29
- 2018A comparison of methods for model selection when estimating individual treatment effectscited by 28
- 2023Identification of Nonlinear Latent Hierarchical Modelscited by 27
- 2022Empirical Analysis of Model Selection for Heterogeneous Causal Effect Estimationcited by 25
- 2020Context-Aware Learning to Rank with Self-Attentioncited by 22
- 2023Self-Compatibility: Evaluating Causal Discovery without Ground Truthcited by 22
- 2023Causal Deep Learningcited by 20
- 2020Supervised Whole DAG Causal Discoverycited by 19
- 2023Causal Reasoning in the Presence of Latent Confounders via Neural ADMG Learningcited by 15
- 2022Causal discovery for observational sciences using supervised machine learningcited by 10
- 2014Multiple Quantitative Trait Analysis Using Bayesian Networkscited by 9
- 2023Rank-Based Causal Discovery for Post-Nonlinear Modelscited by 7
- 2023The Challenges of Hyperparameter Tuning for Accurate Causal Effect Estimationcited by 6
- 2023DiscoGen: Learning to Discover Gene Regulatory Networkscited by 3
- 2020Automated Hyperparameter Selection for the PC Algorithmcited by 2
- 2023How to select predictive models for causal inference?cited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1.
3 papers.