mlsanityData to 7 Oct 2026

U-learning for Prediction Inference via Combinatory Multi-Subsampling: With Applications to LASSO and Neural Networks

arXiv 2407.15301 ↗First posted 22 Jul 2024stat.ML cs.LG math.STcited by 1

Not on the map. Why?

Abstract (arXiv)

Epigenetic aging clocks play a pivotal role in estimating an individual's biological age through the examination of DNA methylation patterns at numerous CpG (Cytosine-phosphate-Guanine) sites within their genome. However, making valid inferences on predicted epigenetic ages, or more broadly, on predictions derived from high-dimensional inputs, presents challenges. We introduce a novel U-learning approach via combinatory multi-subsampling for making ensemble predictions and constructing confidence intervals for predictions of continuous outcomes when traditional asymptotic methods are not applicable. More specifically, our approach conceptualizes the ensemble estimators within the framework of generalized U-statistics and invokes the H'ajek projection for deriving the variances of predictions and constructing confidence intervals with valid conditional coverage probabilities. We apply our approach to two commonly used predictive algorithms, Lasso and deep neural networks (DNNs), and illustrate the validity of inferences with extensive numerical studies. We have applied these methods to predict the DNA methylation age (DNAmAge) of patients with various health conditions, aiming to accurately characterize the aging process and potentially guide anti-aging interventions.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 69 references that are in the map. First posted on arXiv 22 Jul 2024.

Builds on

21 of 69 references.

References · 21

  1. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
  2. 2016Distribution-Free Predictive Inference For Regressioncited by 657
  3. 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
  4. 2019Conformal Prediction Under Covariate Shiftcited by 511
  5. 2017Nonparametric regression using deep neural networks with ReLU activation functioncited by 431
  6. 2020Classification with Valid and Adaptive Coveragecited by 390
  7. 2019Predictive inference with the jackknife+cited by 206
  8. 2019Distributional conformal predictioncited by 104
  9. 2013Exact post-selection inference, with application to the lassocited by 90
  10. 2017Optimal Approximation with Sparsely Connected Deep Neural Networkscited by 90
  11. 2013Confidence Intervals and Hypothesis Testing for High-Dimensional Regressioncited by 78
  12. 2020Predictive Inference Is Free with the Jackknife+-after-Bootstrapcited by 55
9 more
  1. 2016Approximate Residual Balancing: De-Biased Inference of Average Treatment Effects in High Dimensionscited by 50
  2. 2014A General Theory of Hypothesis Tests and Confidence Regions for Sparse High Dimensional Modelscited by 26
  3. 2020Asymptotics of Wide Convolutional Neural Networkscited by 15
  4. 2013Post-Selection Inference for Generalized Linear Models with Many Controlscited by 11
  5. 2016Linear Hypothesis Testing in Dense High-Dimensional Linear Modelscited by 8
  6. 2019Estimation and Inference for High Dimensional Generalized Linear Models: A Splitting and Smoothing Approachcited by 6
  7. 2020Inference for the Case Probability in High-dimensional Logistic Regressioncited by 4
  8. 2021High-dimensional Inference for Dynamic Treatment Effectscited by 2
  9. 2021Inference for High Dimensional Censored Quantile Regressioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.