mlsanityData to 7 Oct 2026

Structured Learning of Compositional Sequential Interventions

arXiv 2406.05745 ↗First posted 9 Jun 2024stat.ML cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

We consider sequential treatment regimes where each unit is exposed to combinations of interventions over time. When interventions are described by qualitative labels, such as "close schools for a month due to a pandemic" or "promote this podcast to this user during this week", it is unclear which appropriate structural assumptions allow us to generalize behavioral predictions to previously unseen combinations of interventions. Standard black-box approaches mapping sequences of categorical variables to outputs are applicable, but they rely on poorly understood assumptions on how reliable generalization can be obtained, and may underperform under sparse sequences, temporal variability, and large action spaces. To approach that, we pose an explicit model for composition, that is, how the effect of sequential interventions can be isolated into modules, clarifying which data conditions allow for the identification of their combined effect at different units and time steps. We show the identification properties of our compositional model, inspired by advances in causal matrix factorization methods. Our focus is on predictive models for novel compositions of interventions instead of matrix completion tasks and causal effect estimation. We compare our approach to flexible but generic black-box models to illustrate how structure aids prediction in sparse data conditions.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 51 references that are in the map. First posted on arXiv 9 Jun 2024.

Builds on

26 of 51 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  3. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  4. 2019Conformal Prediction Under Covariate Shiftcited by 511
  5. 2021Adaptive Conformal Inference Under Distribution Shiftcited by 360
  6. 2020Conformal Inference of Counterfactuals and Individual Treatment Effectscited by 150
  7. 2020Conformal Prediction: a Unified Review of Theory and New Challengescited by 118
  8. 2014Neural Variational Inference and Learning in Belief Networkscited by 116
  9. 2023Conformal PID Control for Time Series Predictioncited by 85
  10. 2023Identifiability Guarantees for Causal Disentanglement from Soft Interventionscited by 84
  11. 2021Causal Matrix Completioncited by 45
  12. 2020Causal Bayesian Optimizationcited by 39
14 more
  1. 2021Causal Effect Inference for Structured Treatmentscited by 38
  2. 2017An Exact and Robust Conformal Inference Method for Counterfactual and Synthetic Controlscited by 36
  3. 2023Off-Policy Evaluation for Large Action Spaces via Conjunct Effect Modelingcited by 34
  4. 2020Synthetic Interventionscited by 25
  5. 2023Identifying Representations for Intervention Extrapolationcited by 21
  6. 2018The Music Streaming Sessions Datasetcited by 18
  7. 2020Causal Imputation via Synthetic Interventionscited by 13
  8. 2023Conformalized matrix completioncited by 13
  9. 2024POTEC: Off-Policy Learning for Large Action Spaces via Two-Stage Policy Decompositioncited by 13
  10. 2023Synthetic Combinations: A Causal Inference Framework for Combinatorial Interventionscited by 12
  11. 2021Parameterizing and Simulating from Causal Modelscited by 9
  12. 2023Intervention Generalization: A View from Factor Graph Modelscited by 7
  13. 2017Semiparametric Causal Sufficient Dimension Reduction Of Multidimensional Treatmentscited by 5
  14. 2024Causal Inference with High-dimensional Discrete Covariatescited by 4

Built on by

Cited by year

Citing papers per year: 2024: 2.

2 papers.