mlsanityData to 14 Oct 2026

Learning Causality for Longitudinal Data

arXiv 2512.04980 ↗First posted 4 Dec 2025stat.ML cs.IT cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

This thesis develops methods for causal inference and causal representation learning (CRL) in high-dimensional, time-varying data. The first contribution introduces the Causal Dynamic Variational Autoencoder (CDVAE), a model for estimating Individual Treatment Effects (ITEs) by capturing unobserved heterogeneity in treatment response driven by latent risk factors that affect only outcomes. CDVAE comes with theoretical guarantees on valid latent adjustment and generalization bounds for ITE error. Experiments on synthetic and real datasets show that CDVAE outperforms baselines, and that state-of-the-art models greatly improve when augmented with its latent substitutes, approaching oracle performance without access to true adjustment variables. The second contribution proposes an efficient framework for long-term counterfactual regression based on RNNs enhanced with Contrastive Predictive Coding (CPC) and InfoMax. It captures long-range dependencies under time-varying confounding while avoiding the computational cost of transformers, achieving state-of-the-art results and introducing CPC into causal inference. The third contribution advances CRL by addressing how latent causes manifest in observed variables. We introduce a model-agnostic interpretability layer based on the geometry of the decoder Jacobian. A sparse self-expression prior induces modular, possibly overlapping groups of observed features aligned with shared latent influences. We provide recovery guarantees in both disjoint and overlapping settings and show that meaningful latent-to-observed structure can be recovered without anchor features or single-parent assumptions. Scalable Jacobian-based regularization techniques are also developed.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 454 references that are in the map. First posted on arXiv 4 Dec 2025.

Builds on

41 of 454 references.

References · 41

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,471
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,824
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,074
  4. 2017Decoupled Weight Decay Regularizationcited by 1,944
  5. 2018Relational inductive biases, deep learning, and graph networkscited by 1,376
  6. 2015Generating Sentences from a Continuous Spacecited by 614
  7. 2019Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishingcited by 194
  8. 2015Deep Kalman Filterscited by 168
  9. 2020What makes instance discrimination good for transfer learning?cited by 112
  10. 2020An Introduction to Proximal Causal Learningcited by 101
  11. 2023Identifiability Results for Multimodal Contrastive Learningcited by 62
  12. 2022Continuous-Time Modeling of Counterfactual Outcomes Using Neural Controlled Differential Equationscited by 60
29 more
  1. 2018Perfect Match: A Simple Method for Learning Representations For Counterfactual Inference With Neural Networkscited by 57
  2. 2021Identifiable Deep Generative Models via Sparse Decodingcited by 56
  3. 2021Variational Causal Networks: Approximate Bayesian Inference over Causal Structurescited by 44
  4. 2018Learning Weighted Representations for Generalization Across Designscited by 43
  5. 2017Learning Independent Features with Adversarial Nets for Non-linear ICAcited by 35
  6. 2018A comparison of methods for model selection when estimating individual treatment effectscited by 29
  7. 2021Sequential Deconfounding for Causal Inference with Unobserved Confounderscited by 25
  8. 2018The Deconfounded Recommender: A Causal Inference Approach to Recommendationcited by 20
  9. 2019Multi-Domain Adversarial Learningcited by 20
  10. 2024A Survey on Deep Tabular Learningcited by 19
  11. 2023Counterfactual Generative Models for Time-Varying Treatmentscited by 18
  12. 2018Multiple Causal Inference with Latent Confoundingcited by 15
  13. 2023Learning Causally Disentangled Representations via the Principle of Independent Causal Mechanismscited by 15
  14. 2022Deep Causal Learning: Representation, Discovery and Inferencecited by 12
  15. 2024Beyond DAGs: A Latent Partial Causal Model for Multimodal Learningcited by 11
  16. 2021Disentangled Counterfactual Recurrent Networks for Treatment Effect Inference over Timecited by 10
  17. 2022Proximal Causal Inference for Marginal Counterfactual Survival Curvescited by 7
  18. 2023Towards Causal Representations of Climate Model Datacited by 7
  19. 2023Estimating Treatment Effects in Continuous Time with Hidden Confounderscited by 4
  20. 2025Conformal Inference of Individual Treatment Effects Using Conditional Density Estimatescited by 4
  21. 2024Nonstationary Time Series Forecasting via Unknown Distribution Adaptationcited by 3
  22. 2024On Identification of Optimal Dynamic Treatment Regimes with Proxies of Hidden Confounderscited by 3
  23. 2019The Blessings of Multiple Causes: A Reply to Ogburn et al. (2019)cited by 2
  24. 2023Causal Dynamic Variational Autoencoder for Counterfactual Regression in Longitudinal Datacited by 2
  25. 2024Bayesian Vector AutoRegression with Factorised Granger-Causal Graphscited by 2
  26. 2024Substitute adjustment via recovery of latent variablescited by 2
  27. 2024Causal Effect Estimation using identifiable Variational AutoEncoder with Latent Confounders and Post-Treatment Variablescited by 2
  28. 2024Increased risk of type I errors for detecting heterogeneity of treatment effects in cluster-randomized trials using mixed-effect modelscited by 1
  29. 2024Interpretable Representation Learning from Videos using Nonlinear Priorscited by 1

Built on by

Not cited yet.