mlsanityData to 7 Oct 2026

Causal inference through multi-stage learning and doubly robust deep neural networks

arXiv 2407.08560 ↗First posted 11 Jul 2024stat.ML cs.LG math.STcited by 2

Not on the map. Why?

Abstract (arXiv)

Deep neural networks (DNNs) have demonstrated remarkable empirical performance in large-scale supervised learning problems, particularly in scenarios where both the sample size n and the dimension of covariates p are large. This study delves into the application of DNNs across a wide spectrum of intricate causal inference tasks, where direct estimation falls short and necessitates multi-stage learning. Examples include estimating the conditional average treatment effect and dynamic treatment effect. In this framework, DNNs are constructed sequentially, with subsequent stages building upon preceding ones. To mitigate the impact of estimation errors from early stages on subsequent ones, we integrate DNNs in a doubly robust manner. In contrast to previous research, our study offers theoretical assurances regarding the effectiveness of DNNs in settings where the dimensionality p expands with the sample size. These findings are significant independently and extend to degenerate single-stage learning problems.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 42 references that are in the map. First posted on arXiv 11 Jul 2024.

Builds on

19 of 42 references.

References · 19

  1. 2018Rethinking the Value of Network Pruningcited by 595
  2. 2016Error bounds for approximations with deep ReLU networkscited by 567
  3. 2017Nonparametric regression using deep neural networks with ReLU activation functioncited by 431
  4. 2017Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networkscited by 304
  5. 2019A Theoretical Analysis of Deep Q-Learningcited by 212
  6. 2019Orthogonal Statistical Learningcited by 150
  7. 2017Double/Debiased/Neyman Machine Learning of Treatment Effectscited by 76
  8. 2019Deep ReLU network approximation of functions on a manifoldcited by 73
  9. 2019Nonparametric Regression on Low-Dimensional Manifolds using Deep ReLU Networks : Function Approximation and Statistical Recoverycited by 73
  10. 2019The Difficulty of Training Sparse Neural Networkscited by 62
  11. 2016Approximate Residual Balancing: De-Biased Inference of Average Treatment Effects in High Dimensionscited by 50
  12. 2013Robust Inference on Average Treatment Effects with Possibly More Covariates than Observationscited by 38
7 more
  1. 2021Besov Function Approximation and Binary Classification on Low-Dimensional Manifolds Using Convolutional Residual Networkscited by 32
  2. 2019A unifying approach for doubly-robust ℓ1 regularized estimation of causal contrastscited by 15
  3. 2020Non-parametric causal effects based on longitudinal modified treatment policiescited by 14
  4. 2017Sequential Double Robustness in Right-Censored Longitudinal Modelscited by 8
  5. 2019Sparsity Double Robust Inference of Average Treatment Effectscited by 7
  6. 2017On the multiply robust estimation of the mean of the g-functionalcited by 6
  7. 2021Dynamic treatment effects: high-dimensional inference under model misspecificationcited by 3

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.