mlsanityData to 7 Oct 2026

Synergizing Deconfounding and Temporal Generalization For Time-series Counterfactual Outcome Estimation

arXiv 2511.16006 ↗First posted 20 Nov 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Estimating counterfactual outcomes from time-series observations is crucial for effective decision-making, e.g. when to administer a life-saving treatment, yet remains significantly challenging because (i) the counterfactual trajectory is never observed and (ii) confounders evolve with time and distort estimation at every step. To address these challenges, we propose a novel framework that synergistically integrates two complementary approaches: Sub-treatment Group Alignment (SGA) and Random Temporal Masking (RTM). Instead of the coarse practice of aligning marginal distributions of the treatments in latent space, SGA uses iterative treatment-agnostic clustering to identify fine-grained sub-treatment groups. Aligning these fine-grained groups achieves improved distributional matching, thus leading to more effective deconfounding. We theoretically demonstrate that SGA optimizes a tighter upper bound on counterfactual risk and empirically verify its deconfounding efficacy. RTM promotes temporal generalization by randomly replacing input covariates with Gaussian noises during training. This encourages the model to rely less on potentially noisy or spuriously correlated covariates at the current step and more on stable historical patterns, thereby improving its ability to generalize across time and better preserve underlying causal relationships. Our experiments demonstrate that while applying SGA and RTM individually improves counterfactual outcome estimation, their synergistic combination consistently achieves state-of-the-art performance. This success comes from their distinct yet complementary roles: RTM enhances temporal generalization and robustness across time steps, while SGA improves deconfounding at each specific time point.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 47 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

21 of 47 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2017Improved Training of Wasserstein GANscited by 2,223
  4. 2017Towards Principled Methods for Training Generative Adversarial Networkscited by 460
  5. 2016Learning Representations for Counterfactual Inferencecited by 327
  6. 2017Near-linear time approximation algorithms for optimal transport via Sinkhorn iterationcited by 219
  7. 2020Estimating Counterfactual Treatment Outcomes over Time Through Adversarially Balanced Representationscited by 154
  8. 2019MIMIC-Extract: A Data Extraction, Preprocessing, and Representation Pipeline for MIMIC-IIIcited by 121
  9. 2022Causal Transformer for Estimating Counterfactual Outcomescited by 121
  10. 2016Theoretical Analysis of Domain Adaptation with Optimal Transportcited by 105
  11. 2019A Wasserstein-type distance in the space of Gaussian Mixture Modelscited by 75
  12. 2020Generalization Bounds and Representation Learning for Estimation of Potential Outcomes and Causal Effectscited by 72
9 more
  1. 2021Time Series Prediction using Deep Learning Methods in Healthcarecited by 71
  2. 2018DeepMatch: Balancing Deep Covariate Representations for Causal Inference Using Adversarial Trainingcited by 42
  3. 2019Adversarial Balancing-based Representation Learning for Causal Effect Inference with Observational Datacited by 29
  4. 2022Hierarchical Sliced Wasserstein Distancecited by 23
  5. 2020DICT-MLM: Improved Multilingual Pre-Training using Bilingual Dictionariescited by 20
  6. 2016A Bayesian Nonparametric Approach for Estimating Individualized Treatment-Response Curvescited by 15
  7. 2018Generative Adversarial Network Training is a Continual Learning Problemcited by 13
  8. 2020G-Net: A Deep Learning Approach to G-computation for Counterfactual Outcome Prediction Under Dynamic Treatment Regimescited by 13
  9. 2022Transfer Learning for Individual Treatment Effect Estimationcited by 5

Built on by

Not cited yet.