Estimating the Long-Term Effects of Novel Treatments
Not on the map. Why?
Abstract (arXiv)
Policy makers typically face the problem of wanting to estimate the long-term effects of novel treatments, while only having historical data of older treatment options. We assume access to a long-term dataset where only past treatments were administered and a short-term dataset where novel treatments have been administered. We propose a surrogate based approach where we assume that the long-term effect is channeled through a multitude of available short-term proxies. Our work combines three major recent techniques in the causal machine learning literature: surrogate indices, dynamic treatment effect estimation and double machine learning, in a unified pipeline. We show that our method is consistent and provides root-n asymptotically normal estimates under a Markovian assumption on the data and the observational policy. We use a data-set from a major corporation that includes customer investments over a three year period to create a semi-synthetic data distribution where the major qualitative properties of the real dataset are preserved. We evaluate the performance of our method and discuss practical challenges of deploying our formal methodology and how to address them.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 8 of its 43 references that are in the map. First posted on arXiv 15 Mar 2021.
Builds on
8 of 43 references.
References · 8
- 2016Data-Efficient Off-Policy Policy Evaluation for Reinforcement Learningcited by 286
- 2019Double Reinforcement Learning for Efficient Off-Policy Evaluation in Markov Decision Processescited by 119
- 2019Efficiently Breaking the Curse of Horizon in Off-Policy Evaluation with Double Reinforcement Learningcited by 75
- 2019Learning When-to-Treat Policiescited by 49
- 2020Double/Debiased Machine Learning for Dynamic Treatment Effects via g-Estimationcited by 27
- 2015Structural Nested Models and G-estimation: The Partially Realized Promisecited by 15
- 2016Estimating Treatment Effects using Multiple Surrogates: The Role of the Surrogate Score and the Surrogate Indexcited by 12
- 2020Evaluating (weighted) dynamic treatment effects by double machine learningcited by 11
Built on by
Citing papers per year: 2022: 3; 2023: 1; 2024: 2; 2025: 1; 2026: 1.
8 papers.
- 2022Deep End-to-end Causal Inferencecited by 95
- 2022Long-term Causal Inference Under Persistent Confounding via Data Combinationcited by 27
- 2024A Fixed-Point Approach for Causal Generative Modelingcited by 7
- 2022Kernel methods for long term dose response curvescited by 4
- 2023Benchmarking Bayesian Causal Discovery Methods for Downstream Treatment Effect Estimationcited by 3
- 2024Predicting Long Term Sequential Policy Value Using Softer Surrogatescited by 0
- 2025Sequential Treatment Effect Estimation with Unmeasured Confounderscited by 0
- 2026SIRNET: Causal Adaptation of Pretrained Embeddings for Semiparametric Treatment-Effect Estimation Under Surrogacycited by 0
- 2026SIRNET: Causal Adaptation of Pretrained Embeddings for Semiparametric Treatment-Effect Estimation Under Surrogacy29 Sep 2026
- 2025Sequential Treatment Effect Estimation with Unmeasured Confounders14 May 2025
- 2024Predicting Long Term Sequential Policy Value Using Softer Surrogates30 Dec 2024
- 2024A Fixed-Point Approach for Causal Generative Modeling10 Apr 2024
- 2023Benchmarking Bayesian Causal Discovery Methods for Downstream Treatment Effect Estimation11 Jul 2023
- 2022Long-term Causal Inference Under Persistent Confounding via Data Combination15 Feb 2022
- 2022Deep End-to-end Causal Inference4 Feb 2022
- 2022Kernel methods for long term dose response curves13 Jan 2022