mlsanityData to 14 Oct 2026

Automatic Debiased Machine Learning for Smooth Functionals of Nonparametric M-Estimands

arXiv 2501.11868 ↗First posted 21 Jan 2025stat.ME math.ST stat.MLcited by 7

Not on the map. Why?

Abstract (arXiv)

We develop a unified framework for automatic debiased machine learning (autoDML) for inference on a broad class of statistical parameters. The framework applies to any smooth functional of a nonparametric M-estimand, defined as the minimizer of a population risk over an infinite-dimensional linear space. Examples include counterfactual regression, quantile, and survival functions, as well as conditional average treatment effects. Rather than requiring manual derivation of influence functions, our approach automates the construction of debiased estimators using three ingredients: the gradient and Hessian of the loss function and a linear approximation of the target functional. Estimation reduces to solving two risk minimization problems, one for the M-estimand and one for a Riesz representer. The framework accommodates Neyman-orthogonal loss functions that depend on nuisance parameters and extends to vector-valued M-estimands through joint risk minimization. We characterize the efficient influence function and construct efficient autoDML estimators via one-step correction, targeted minimum loss estimation, and sieve-based plug-in methods. Under quadratic risk, these estimators satisfy double robustness for linear functionals. We further show that they are robust to mild misspecification of the M-estimand model, incurring only second-order bias. We illustrate the method by estimating long-term survival probabilities under a semiparametric two-parameter beta-geometric failure model.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 28 of its 84 references that are in the map. First posted on arXiv 21 Jan 2025.

Builds on

28 of 84 references.

References · 28

  1. 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 332
  2. 2019Orthogonal Statistical Learningcited by 151
  3. 2016Balancing Covariates via Propensity Score Weightingcited by 65
  4. 2018Deep Neural Networks for Estimation and Inferencecited by 62
  5. 2015The Influence Function of Semiparametric Estimatorscited by 36
  6. 2019Machine Learning Estimation of Heterogeneous Treatment Effects with Instrumentscited by 29
  7. 2021Long Story Short: Omitted Variable Bias in Causal Machine Learningcited by 23
  8. 2023Augmented balancing weights as linear regressioncited by 21
  9. 2021The Balancing Act in Causal Inferencecited by 20
  10. 2024Combining T-learning and DR-learning: a framework for oracle-efficient estimation of causal contrastscited by 18
  11. 2023Causal isotonic calibration for heterogeneous treatment effectscited by 16
  12. 2023Automatic Debiased Machine Learning for Covariate Shiftscited by 16
16 more
  1. 2019Efficient Estimation of Pathwise Differentiable Target Parameters with the Undersmoothed Highly Adaptive Lassocited by 13
  2. 2023One-Step Estimation of Differentiable Hilbert-Valued Parameterscited by 11
  3. 2024Simplifying debiased inference via automatic differentiation and probabilistic programmingcited by 10
  4. 2023Source Condition Double Robust Inference on Functionals of Inverse Problemscited by 9
  5. 2024Stabilized Inverse Probability Weighting via Isotonic Calibrationcited by 9
  6. 2021Median Optimal Treatment Regimescited by 7
  7. 2023Proximal Causal Learning of Conditional Average Treatment Effectscited by 7
  8. 2023Adaptive debiased machine learning using data-driven model selection techniquescited by 7
  9. 2024Adaptive-TMLE for the Average Treatment Effect based on Randomized Controlled Trial Augmented with Real-World Datacited by 7
  10. 2018Regularized Orthogonal Machine Learning for Nonlinear Semiparametric Modelscited by 6
  11. 2024Orthogonal Causal Calibrationcited by 6
  12. 2025RieszBoost: Gradient Boosting for Riesz Regressioncited by 6
  13. 2020Universal sieve-based strategies for efficient estimation using machine learning toolscited by 4
  14. 2023Forster-Warmuth Counterfactual Regression: A Unified Learning Approachcited by 4
  15. 2021Why Machine Learning Cannot Ignore Maximum Likelihood Estimationcited by 3
  16. 2019Beta Survival Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.