Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding
Not on the map. Why?
Abstract (arXiv)
Understanding and quantifying cause and effect is an important problem in many domains. The generally-agreed solution to this problem is to perform a randomised controlled trial. However, even when randomised controlled trials can be performed, they usually have relatively short duration's due to cost considerations. This makes learning long-term causal effects a very challenging task in practice, since the long-term outcome is only observed after a long delay. In this paper, we study the identification and estimation of long-term treatment effects when both experimental and observational data are available. Previous work provided an estimation strategy to determine long-term causal effects from such data regimes. However, this strategy only works if one assumes there are no unobserved confounders in the observational data. In this paper, we specifically address the challenging case where unmeasured confounders are present in the observational data. Our long-term causal effect estimator is obtained by combining regression residuals with short-term experimental outcomes in a specific manner to create an instrumental variable, which is then used to quantify the long-term causal effect through instrumental variable regression. We prove this estimator is unbiased, and analytically study its variance. In the context of the front-door causal structure, this provides a new causal estimator, which may be of independent interest. Finally, we empirically test our approach on synthetic-data, as well as real-data from the International Stroke Trial.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 9 of its 25 references that are in the map. First posted on arXiv 21 Feb 2023.
Builds on
9 of 25 references.
References · 9
- 2020An Introduction to Proximal Causal Learningcited by 95
- 2016Double/Debiased Machine Learning for Treatment and Causal Parameterscited by 43
- 2022Long-term Causal Inference Under Persistent Confounding via Data Combinationcited by 27
- 2020Long-Term Effect Estimation with Surrogate Representationcited by 15
- 2019Integrating overlapping datasets using bivariate causal discoverycited by 12
- 2022Disentangling Causal Effects from Sets of Interventions in the Presence of Unobserved Confounderscited by 10
- 2019Leveraging directed causal discovery to detect latent common causescited by 9
- 2020Estimating Treatment Effects with Observed Confounders and Mediatorscited by 8
- 2015Causal inference via algebraic geometry: feasibility tests for functional causal structures with two binary observed variablescited by 6
Built on by
Citing papers per year: 2024: 5; 2025: 4; 2026: 3.
12 papers.
- 2024Contrastive representations of high-dimensional, structured treatmentscited by 7
- 2024Learning Metrics that Maximise Power for Accelerated A/B-Testscited by 6
- 2024The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoningcited by 5
- 2024Spillover Detection for Donor Selection in Synthetic Control Modelscited by 4
- 2024Estimating Long-term Heterogeneous Dose-response Curve: Generalization Bound Leveraging Optimal Transport Weightscited by 4
- 2025The Hardness of Validating Observational Studies with Experimental Datacited by 4
- 2025Local Interference: Removing Interference Bias in Semi-Parametric Causal Modelscited by 1
- 2025Identification and Estimation of Long-Term Treatment Effects with Monotone Missingcited by 0
- 2025Quantum oracles give an advantage for identifying classical counterfactualscited by 0
- 2026Testing Effect Homogeneity and Confounding in High-Dimensional Experimental and Observational Studiescited by 0
- 2026Orthogonal Learner for Estimating Heterogeneous Long-Term Treatment Effectscited by 0
- 2026Beyond Temporal Proximity: Explanatory World Models for Credit Assignment in Reinforcement Learningcited by 0
- 2026Beyond Temporal Proximity: Explanatory World Models for Credit Assignment in Reinforcement Learning9 Oct 2026
- 2026Orthogonal Learner for Estimating Heterogeneous Long-Term Treatment Effects1 Apr 2026
- 2026Testing Effect Homogeneity and Confounding in High-Dimensional Experimental and Observational Studies23 Feb 2026
- 2025Quantum oracles give an advantage for identifying classical counterfactuals15 Dec 2025
- 2025Identification and Estimation of Long-Term Treatment Effects with Monotone Missing28 Apr 2025
- 2025Local Interference: Removing Interference Bias in Semi-Parametric Causal Models24 Mar 2025
- 2025The Hardness of Validating Observational Studies with Experimental Data19 Mar 2025
- 2024Contrastive representations of high-dimensional, structured treatments28 Nov 2024
- 2024The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning27 Jun 2024
- 2024Estimating Long-term Heterogeneous Dose-response Curve: Generalization Bound Leveraging Optimal Transport Weights27 Jun 2024
- 2024Spillover Detection for Donor Selection in Synthetic Control Models17 Jun 2024
- 2024Learning Metrics that Maximise Power for Accelerated A/B-Tests6 Feb 2024