mlsanityData to 7 Oct 2026

Kernel Debiased Plug-in Estimation based on the Universal Least Favorable Submodel

arXiv 2603.08945 ↗First posted 9 Mar 2026math.ST cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose ULFS-KDPE, a kernel debiased plug-in estimator based on the universal least favorable submodel, for estimating pathwise differentiable parameters in nonparametric models. The method constructs a data-adaptive debiasing flow in a reproducing kernel Hilbert space (RKHS), producing a plug-in estimator that achieves semiparametric efficiency without requiring explicit derivation or evaluation of efficient influence functions. We place ULFS-KDPE on a rigorous functional-analytic foundation by formulating the universal least favorable update as a nonlinear ordinary differential equation on probability densities. We establish existence, uniqueness, stability, and finite-time convergence of the empirical score along the induced flow. Under standard regularity conditions, the resulting estimator is regular, asymptotically linear, and attains the semiparametric efficiency bound simultaneously for a broad class of pathwise differentiable parameters. The method admits a computationally tractable implementation based on finite-dimensional kernel representations and principled stopping criteria. In finite samples, the combination of solving a rich collection of score equations with RKHS-based smoothing and avoidance of direct influence-function evaluation leads to improved numerical stability. Simulation studies illustrate the method and support the theoretical results.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 29 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

6 of 29 references.

References · 6

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  2. 2017Double/Debiased/Neyman Machine Learning of Treatment Effectscited by 76
  3. 2019Efficient Estimation of Pathwise Differentiable Target Parameters with the Undersmoothed Highly Adaptive Lassocited by 12
  4. 2023Kernel Debiased Plug-in Estimation: Simultaneous, Automated Debiasing without Influence Functions for Many Target Parameterscited by 5
  5. 2025Automatic Debiased Machine Learning for Smooth Functionals of Nonparametric M-Estimandscited by 5
  6. 2024Automated Efficient Estimation using Monte Carlo Efficient Influence Functionscited by 4

Built on by

Not cited yet.