Deep Doubly Debiased Longitudinal Effect Estimation with ICE G-Computation
Not on the map. Why?
Abstract (arXiv)
Estimating longitudinal treatment effects is essential for sequential decision-making but is challenging due to treatment-confounder feedback. While Iterative Conditional Expectation (ICE) G-computation offers a principled approach, its recursive structure suffers from error propagation, corrupting the learned outcome regression models. We propose D3-Net, a framework that mitigates error propagation in ICE training and then applies a robust final correction. First, to interrupt error propagation during learning, we train the ICE sequence using Sequential Doubly Robust (SDR) pseudo-outcomes, which provide bias-corrected targets for each regression. Second, we employ a multi-task transformer with a covariate simulator head for auxiliary supervision, regularizing representation learning, and a target network to stabilize training dynamics. For the final estimate, we discard the SDR correction and instead use the uncorrected nuisance models to perform Longitudinal Targeted Minimum Loss-Based Estimation (LTMLE) on the original outcomes. This second-stage, targeted debiasing ensures robustness and optimal finite-sample properties. Comprehensive experiments demonstrate that our model, D3-Net, robustly reduces bias and variance across different horizons, counterfactuals, and time-varying confoundings, compared to existing state-of-the-art ICE-based estimators.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 75 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
27 of 75 references.
References · 27
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2015Doubly Robust Off-policy Value Evaluation for Reinforcement Learningcited by 339
- 2016Data-Efficient Off-Policy Policy Evaluation for Reinforcement Learningcited by 286
- 2020Decoupling Representation Learning from Reinforcement Learningcited by 269
- 2019Batch Policy Learning under Constraintscited by 244
- 2018Breaking the Curse of Horizon: Infinite-Horizon Off-Policy Estimationcited by 227
- 2020Estimating Counterfactual Treatment Outcomes over Time Through Adversarially Balanced Representationscited by 155
- 2019MIMIC-Extract: A Data Extraction, Preprocessing, and Representation Pipeline for MIMIC-IIIcited by 122
- 2019Empirical Study of Off-Policy Policy Evaluation for Reinforcement Learningcited by 121
- 2020Minimax-Optimal Off-Policy Evaluation with Linear Function Approximationcited by 120
- 2019Double Reinforcement Learning for Efficient Off-Policy Evaluation in Markov Decision Processescited by 119
15 more
- 2018Importance Sampling Policy Evaluation with an Estimated Behavior Policycited by 34
- 2022Estimating average causal effects from patient trajectoriescited by 29
- 2020Double/Debiased Machine Learning for Dynamic Treatment Effects via g-Estimationcited by 27
- 2019Importance Resampling for Off-policy Predictioncited by 26
- 2024Model-agnostic meta-learners for estimating heterogeneous treatment effects over timecited by 19
- 2019More Efficient Off-Policy Evaluation through Regularized Targeted Learningcited by 17
- 2020Non-parametric causal effects based on longitudinal modified treatment policiescited by 14
- 2020Evaluating (weighted) dynamic treatment effects by double machine learningcited by 11
- 2017Sequential Double Robustness in Right-Censored Longitudinal Modelscited by 10
- 2024Longitudinal Targeted Minimum Loss-based Estimation with Temporal-Difference Heterogeneous Transformercited by 10
- 2024IGC-Net for conditional average potential outcome estimation over timecited by 10
- 2023Predictive auxiliary objectives in deep RL mimic learning in the braincited by 7
- 2023Kernel Debiased Plug-in Estimation: Simultaneous, Automated Debiasing without Influence Functions for Many Target Parameterscited by 5
- 2024Deep Learning Methods for the Noniterative Conditional Expectation G-Formula for Causal Inference from Complex Observational Datacited by 3
- 2024Estimating the treatment effect over time under general interference through deep learner integrated TMLEcited by 3
Built on by
Not cited yet.