mlsanityData to 14 Oct 2026

Causal State-Space Model for Causal Inference: Estimating Longitudinal Individual Treatment Effects

arXiv 2608.08288 ↗First posted 8 Aug 2026cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Estimating counterfactual outcomes over time from longitudinal observational data is central to clinical decision support. Existing methods rely on domain confusion -- adversarial training that renders representations invariant to treatment assignment -- yet this invariance creates a mutual information conflict: it suppresses treatment-correlated covariate signals necessary for accurate outcome prediction. We formalise this tension via a Jensen-Shannon divergence bound on counterfactual prediction error and develop two complementary models. CSSD (Causal State-Space model with Direct decoder) adapts selective State Space Models with a parallel multi-step decoder that eliminates accumulated rollout error by producing all prediction horizons simultaneously in a single forward pass. CSSPD (Causal State-Space model with Predictive regularisation and Direct decoder) augments CSSD with Contrastive Predictive Coding and Local Information Maximisation to reinforce temporal predictability in the balancing representation and recover local covariate information destroyed by domain confusion. On MIMIC-III, CSSPD achieves lower counterfactual RMSE than the Causal Transformer at every horizon tau >= 2 at O(T) encoder cost, with gains from 0.02 (2-step) to 0.07 (6-step). On Cancer Simulation across confounding strengths gamma in {0,1,2,3,4}, CSSPD outperforms CT at gamma <= 3 (margins 25.9%--37.0%), and CSSD achieves the lowest overall average RMSE (12.7% reduction over CT), confirming the MI conflict analysis. To our knowledge, this is the first work to formalise the balancing-prediction MI conflict and propose a structured resolution through complementary predictive and information-theoretic training objectives.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 35 references that are in the map. First posted on arXiv 8 Aug 2026.

Builds on

14 of 35 references.

References · 14

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  4. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  5. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
  6. 2022Simplified State Space Layers for Sequence Modelingcited by 788
  7. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240
  8. 2020Estimating Counterfactual Treatment Outcomes over Time Through Adversarially Balanced Representationscited by 155
  9. 2022Causal Transformer for Estimating Counterfactual Outcomescited by 123
  10. 2020Generalization Bounds and Representation Learning for Estimation of Potential Outcomes and Causal Effectscited by 72
  11. 2022S4ND: Modeling Images and Videos as Multidimensional Signals Using State Spacescited by 41
  12. 2023Bounds on Representation-Induced Confounding Bias for Treatment Effect Estimationcited by 20
2 more
  1. 2024Causal Contrastive Learning for Counterfactual Regression Over Timecited by 7
  2. 2026CAETC: Causal Autoencoding and Treatment Conditioning for Counterfactual Estimation over Timecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Counterfactual Outcome Prediction using Structured State Space Model
  2. 2026Causal Diffusion Models for Counterfactual Outcome Distributions in Longitudinal Data
  3. 2024DiffusionCounterfactuals: Inferring High-dimensional Counterfactuals with Guidance of Causal Representations
  4. 2025Flow-based Generative Modeling of Potential Outcomes and Counterfactuals
  5. 2023Counterfactual Generative Models for Time-Varying Treatments
  6. 2025Technical Report: Facilitating the Adoption of Causal Inference Methods Through LLM-Empowered Co-Pilot
  7. 2023Towards Causal Foundation Model: on Duality between Causal Inference and Attention
  8. 2025Deep Disentangled Representation Network for Treatment Effect Estimation