mlsanityData to 7 Oct 2026

Leveraging a Simulator for Learning Causal Representations from Post-Treatment Covariates for CATE

arXiv 2502.05037 ↗First posted 7 Feb 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Treatment effect estimation involves assessing the impact of different treatments on individual outcomes. Current methods estimate Conditional Average Treatment Effect (CATE) using observational datasets where covariates are collected before treatment assignment and outcomes are observed afterward, under assumptions like positivity and unconfoundedness. In this paper, we address a scenario where both covariates and outcomes are gathered after treatment. We show that post-treatment covariates render CATE unidentifiable, and recovering CATE requires learning treatment-independent causal representations. Prior work shows that such representations can be learned through contrastive learning if counterfactual supervision is available in observational data. However, since counterfactuals are rare, other works have explored using simulators that offer synthetic counterfactual supervision. Our goal in this paper is to systematically analyze the role of simulators in estimating CATE. We analyze the CATE error of several baselines and highlight their limitations. We then establish a generalization bound that characterizes the CATE error from jointly training on real and simulated distributions, as a function of the real-simulator mismatch. Finally, we introduce SimPONet, a novel method whose loss function is inspired from our generalization bound. We further show how SimPONet adjusts the simulator's influence on the learning objective based on the simulator's relevance to the CATE task. We experiment with various DGPs, by systematically varying the real-simulator distribution gap to evaluate SimPONet's efficacy against state-of-the-art CATE baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 69 references that are in the map. First posted on arXiv 7 Feb 2025.

Builds on

32 of 69 references.

References · 32

  1. 2016Density estimation using Real NVPcited by 2,029
  2. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  3. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
  4. 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 475
  5. 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 328
  6. 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 308
  7. 2019Adapting Neural Networks for the Estimation of Treatment Effectscited by 285
  8. 2020Deep Structural Causal Models for Tractable Counterfactual Inferencecited by 210
  9. 2021Counterfactual Generative Networkscited by 111
  10. 2019On the Transfer of Inductive Bias from Simulation to the Real World: a New Disentanglement Datasetcited by 100
  11. 2019Learning Counterfactual Representations for Estimating Individual Dose-Response Curvescited by 90
  12. 2022Diffusion Models for Counterfactual Explanationscited by 79
20 more
  1. 2020Generate Your Counterfactuals: Towards Controlled Counterfactual Generation for Textcited by 75
  2. 2021On Inductive Biases for Heterogeneous Treatment Effect Estimationcited by 74
  3. 2021VCNet and Functional Targeted Regularization For Learning Causal Effects of Continuous Treatmentscited by 59
  4. 2018Perfect Match: A Simple Method for Learning Representations For Counterfactual Inference With Neural Networkscited by 55
  5. 2018DeepMatch: Balancing Deep Covariate Representations for Causal Inference Using Adversarial Trainingcited by 42
  6. 2022DoCoGen: Domain Counterfactual Generation for Low Resource Domain Adaptationcited by 36
  7. 2023Optimal Transport for Treatment Effect Estimationcited by 32
  8. 2022DISCO: Distilling Counterfactuals with Large Language Modelscited by 29
  9. 2023In Search of Insights, Not Magic Bullets: Towards Demystification of the Model Selection Dilemma in Heterogeneous Treatment Effect Estimationcited by 29
  10. 2023BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeyscited by 29
  11. 2021A Survey on Simulators for Testing Self-Driving Carscited by 26
  12. 2022Exploring Transformer Backbones for Heterogeneous Treatment Effect Estimationcited by 25
  13. 2022CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generationcited by 23
  14. 2024Counterfactual Image Editingcited by 20
  15. 2021Designing Counterfactual Generators using Deep Model Inversioncited by 15
  16. 2018Adversarial Balancing for Causal Inferencecited by 10
  17. 2022Adversarial De-confounding in Individualised Treatment Effects Estimationcited by 9
  18. 2020Minimax Optimal Nonparametric Estimation of Heterogeneous Treatment Effectscited by 8
  19. 2024Continuous Treatment Effect Estimation Using Gradient Interpolation and Kernel Smoothingcited by 7
  20. 2024PairNet: Training with Observed Pairs to Estimate Individual Treatment Effectcited by 3

Built on by

Not cited yet.