# De-Biased Machine Learning of Global and Local Parameters Using Regularized Riesz Representers

arXiv: https://arxiv.org/abs/1802.08667 · HTML: https://mlsanity.com/paper/1802.08667/

## Key facts

- Cited by 34 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Feb 2018.

## Built on by (most cited first, 30 of 34)

- [A Review of Off-Policy Evaluation in Reinforcement Learning](https://mlsanity.com/paper/2212.06355/) (2022)
- [Finite Sample Analysis of Minimax Offline Reinforcement Learning: Completeness, Fast Rates and First-Order Efficiency](https://mlsanity.com/paper/2102.02981/) (2021)
- [RieszNet and ForestRiesz: Automatic Debiased Machine Learning with Neural Nets and Random Forests](https://mlsanity.com/paper/2110.03031/) (2021)
- [Knowledge Distillation as Semiparametric Inference](https://mlsanity.com/paper/2104.09732/) (2021)
- [Long-term Causal Inference Under Persistent Confounding via Data Combination](https://mlsanity.com/paper/2202.07234/) (2022)
- [Long Story Short: Omitted Variable Bias in Causal Machine Learning](https://mlsanity.com/paper/2112.13398/) (2021)
- [Augmented balancing weights as linear regression](https://mlsanity.com/paper/2304.14545/) (2023)
- [Doubly Robust Self-Training](https://mlsanity.com/paper/2306.00265/) (2023)
- [Debiased Machine Learning without Sample-Splitting for Stable Estimators](https://mlsanity.com/paper/2206.01825/) (2022)
- [Inference on Strongly Identified Functionals of Weakly Identified Functions](https://mlsanity.com/paper/2208.08291/) (2022)
- [One-Step Estimation of Differentiable Hilbert-Valued Parameters](https://mlsanity.com/paper/2303.16711/) (2023)
- [A Simple and General Debiased Machine Learning Theorem with Finite Sample Guarantees](https://mlsanity.com/paper/2105.15197/) (2021)
- [Adaptive debiased machine learning using data-driven model selection techniques](https://mlsanity.com/paper/2307.12544/) (2023)
- [Kernel Ridge Riesz Representers: Generalization, Mis-specification, and the Counterfactual Effective Dimension](https://mlsanity.com/paper/2102.11076/) (2021)
- [Orthogonal Causal Calibration](https://mlsanity.com/paper/2406.01933/) (2024)
- [Balancing Interference and Correlation in Spatial Experimental Designs: A Causal Graph Cut Approach](https://mlsanity.com/paper/2505.20130/) (2025)
- [Double Robust Bayesian Inference on Average Treatment Effects](https://mlsanity.com/paper/2211.16298/) (2022)
- [Inference on Optimal Dynamic Policies via Softmax Approximation](https://mlsanity.com/paper/2303.04416/) (2023)
- [Optimally taming biases in black-box models for efficient semiparametric estimation](https://mlsanity.com/paper/2606.06368/) (2026)
- [Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators](https://mlsanity.com/paper/2306.10590/) (2023)
- [Automatic debiasing of neural networks via moment-constrained learning](https://mlsanity.com/paper/2409.19777/) (2024)
- [Semiparametric inference for impulse response functions using double/debiased machine learning](https://mlsanity.com/paper/2411.10009/) (2024)
- [Learning High-dimensional Gaussians from Censored Data](https://mlsanity.com/paper/2504.19446/) (2025)
- [Generalized Kernel Ridge Regression for Causal Inference with Missing-at-Random Sample Selection](https://mlsanity.com/paper/2111.05277/) (2021)
- [General targeted machine learning for modern causal mediation analysis](https://mlsanity.com/paper/2408.14620/) (2024)
- [Double Debiased Machine Learning for Mediation Analysis with Continuous Treatments](https://mlsanity.com/paper/2503.06156/) (2025)
- [Regularizing Extrapolation in Causal Inference](https://mlsanity.com/paper/2509.17180/) (2025)
- [Debiased neural operators for estimating functionals](https://mlsanity.com/paper/2604.19296/) (2026)
- [Optimal use of a black-box learner in semiparametric estimation](https://mlsanity.com/paper/2607.21541/) (2026)
- [A Machine Learning Approach to Measuring Climate Adaptation](https://mlsanity.com/paper/2302.01236/) (2023)

## Abstract (arXiv)

We provide adaptive inference methods, based on ℓ1 regularization, for regular (semi-parametric) and non-regular (nonparametric) linear functionals of the conditional expectation function. Examples of regular functionals include average treatment effects, policy effects, and derivatives. Examples of non-regular functionals include average treatment effects, policy effects, and derivatives conditional on a covariate subvector fixed at a point. We construct a Neyman orthogonal equation for the target parameter that is approximately invariant to small perturbations of the nuisance parameters. To achieve this property, we include the Riesz representer for the functional as an additional nuisance parameter. Our analysis yields weak ``double sparsity robustness'': either the approximation to the regression or the approximation to the representer can be ``completely dense'' as long as the other is sufficiently ``sparse''. Our main results are non-asymptotic and imply asymptotic uniform validity over large classes of models, translating into honest confidence bands for both global and local parameters.