mlsanityData to 14 Oct 2026

Orthogonal Bootstrap: Efficient Simulation of Input Uncertainty

arXiv 2404.19145 ↗First posted 29 Apr 2024stat.ME cs.LG econ.EMcited by 0

Not on the map. Why?

Abstract (arXiv)

Bootstrap is a popular methodology for simulating input uncertainty. However, it can be computationally expensive when the number of samples is large. We propose a new approach called Orthogonal Bootstrap that reduces the number of required Monte Carlo replications. We decomposes the target being simulated into two parts: the textitnon-orthogonal part which has a closed-form result known as Infinitesimal Jackknife and the textitorthogonal part which is easier to be simulated. We theoretically and numerically show that Orthogonal Bootstrap significantly reduces the computational cost of Bootstrap while improving empirical accuracy and maintaining the same width of the constructed interval.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 63 references that are in the map. First posted on arXiv 29 Apr 2024.

Builds on

18 of 63 references.

References · 18

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  3. 2016Kernel Mean Embedding of Distributions: A Review and Beyondcited by 364
  4. 2020An Investigation of Why Overparameterization Exacerbates Spurious Correlationscited by 310
  5. 2019Orthogonal Statistical Learningcited by 151
  6. 2018A Swiss Army Infinitesimal Jackknifecited by 54
  7. 2013Confidence Intervals for Random Forests: The Jackknife and the Infinitesimal Jackknifecited by 44
  8. 2020Discriminative Jackknife: Quantifying Uncertainty in Deep Learning via Higher-Order Influence Functionscited by 34
  9. 2019A Higher-Order Swiss Army Infinitesimal Jackknifecited by 14
  10. 2022Approximating Full Conformal Prediction at Scale via Influence Functionscited by 11
  11. 2018Subsampling to Enhance Efficiency in Input Uncertainty Quantificationcited by 6
  12. 2014Influence Functions for Machine Learning: Nonparametric Estimators for Entropies, Divergences and Mutual Informationscited by 5
6 more
  1. 2015A subsampled double bootstrap for massive datacited by 5
  2. 2022A Cheap Bootstrap Method for Fast Inferencecited by 5
  3. 2017Bias Correction with Jackknife, Bootstrap, and Taylor Seriescited by 4
  4. 2021Debiasing Samples from Online Learning Using Bootstrapcited by 3
  5. 2022Constructing Prediction Intervals with Neural Networks: An Empirical Evaluation of Bootstrapping and Conformal Inference Methodscited by 2
  6. 2022Correcting Convexity Bias in Function and Functional Estimatecited by 1

Built on by

Not cited yet.