mlsanityData to 7 Oct 2026

Intervention Generalization: A View from Factor Graph Models

arXiv 2306.04027 ↗First posted 6 Jun 2023stat.ML cs.AI cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

One of the goals of causal inference is to generalize from past experiments and observational data to novel conditions. While it is in principle possible to eventually learn a mapping from a novel experimental condition to an outcome of interest, provided a sufficient variety of experiments is available in the training data, coping with a large combinatorial space of possible interventions is hard. Under a typical sparse experimental design, this mapping is ill-posed without relying on heavy regularization or prior distributions. Such assumptions may or may not be reliable, and can be hard to defend or test. In this paper, we take a close look at how to warrant a leap from past experiments to novel conditions based on minimal assumptions about the factorization of the distribution of the manipulated system, communicated in the well-understood language of factor graph models. A postulated textitinterventional factor model (IFM) may not always be informative, but it conveniently abstracts away a need for explicitly modeling unmeasured confounding and feedback mechanisms, leading to directly testable claims. Given an IFM and datasets from a collection of experimental regimes, we derive conditions for identifiability of the expected outcomes of new regimes never observed in these training data. We implement our framework using several efficient algorithms, and apply them on a range of semi-synthetic experiments.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 32 of its 84 references that are in the map. First posted on arXiv 6 Jun 2023.

Builds on

32 of 84 references.

References · 32

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  2. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  3. 2019Invariant Risk Minimizationcited by 1,832
  4. 2016Distribution-Free Predictive Inference For Regressioncited by 657
  5. 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
  6. 2019Conformal Prediction Under Covariate Shiftcited by 511
  7. 2017Invariant Causal Prediction for Nonlinear Modelscited by 140
  8. 2016Foundations of Structural Causal Models with Cycles and Latent Variablescited by 134
  9. 2017Domain Adaptation by Using Causal Inference to Predict Invariant Conditional Distributionscited by 125
  10. 2018Invariance, Causality and Robustnesscited by 123
  11. 2020Invariant Causal Prediction for Block MDPscited by 104
  12. 2016Causal Bandits: Learning Good Interventions via Causal Inferencecited by 100
20 more
  1. 2017Invariant Causal Prediction for Sequential Datacited by 63
  2. 2022Interventions, Where and How? Experimental Design for Causal Models at Scalecited by 49
  3. 2020Causal Bayesian Optimizationcited by 39
  4. 2018Constraint-based Causal Discovery for Non-Linear Structural Causal Models with Cycles and Latent Confounderscited by 35
  5. 2020Domain adaptation under structural causal modelscited by 28
  6. 2022Model-based Causal Bayesian Optimizationcited by 26
  7. 2022Adaptively Exploiting d-Separators with Causal Banditscited by 18
  8. 2019Characterization of Overlap in Observational Studiescited by 15
  9. 2020How and Why to Use Experimental Data to Evaluate Methods for Observational Causal Inferencecited by 13
  10. 2020Causal Imputation via Synthetic Interventionscited by 13
  11. 2021On the Assumptions of Synthetic Control Methodscited by 12
  12. 2023Synthetic Combinations: A Causal Inference Framework for Combinatorial Interventionscited by 12
  13. 2014Causal Inference with a Graphical Hierarchy of Interventionscited by 11
  14. 2018Causal inference, social networks, and chain graphscited by 11
  15. 2021Rethinking Importance Weighting for Transfer Learningcited by 11
  16. 2013A Kernel Test for Three-Variable Interactionscited by 10
  17. 2021Operationalizing Complex Causes: A Pragmatic View of Mediationcited by 8
  18. 2015Extended Conditional Independence and Applications in Causal Inferencecited by 7
  19. 2020Learning Joint Nonlinear Effects from Single-variable Interventions in the Presence of Hidden Confounderscited by 7
  20. 2021Causality and independence in perfectly adapted dynamical systemscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 3; 2026: 1.

7 papers.