mlsanityData to 14 Oct 2026

Online multiple testing with e-values

arXiv 2311.06412 ↗First posted 10 Nov 2023stat.ME stat.MLcited by 12

Not on the map. Why?

Abstract (arXiv)

A scientist tests a continuous stream of hypotheses over time in the course of her investigation -- she does not test a predetermined, fixed number of hypotheses. The scientist wishes to make as many discoveries as possible while ensuring the number of false discoveries is controlled -- a well recognized way for accomplishing this is to control the false discovery rate (FDR). Prior methods for FDR control in the online setting have focused on formulating algorithms when specific dependency structures are assumed to exist between the test statistics of each hypothesis. However, in practice, these dependencies often cannot be known beforehand or tested after the fact. Our algorithm, e-LOND, provides FDR control under arbitrary, possibly unknown, dependence. We show that our method is more powerful than existing approaches to this problem through simulations. We also formulate extensions of this algorithm to utilize randomization for increased power, and for constructing confidence intervals in online selective inference.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 36 of its 69 references that are in the map. First posted on arXiv 10 Nov 2023.

Builds on

36 of 69 references.

References · 36

  1. 2018Time-uniform, nonparametric, nonasymptotic confidence sequencescited by 229
  2. 2020Estimating means of bounded random variables by bettingcited by 169
  3. 2022Game-theoretic statistics and safe anytime-valid inferencecited by 155
  4. 2014Preserving Statistical Validity in Adaptive Data Analysiscited by 103
  5. 2019Safe Testingcited by 101
  6. 2020Kaggle forecasting competitions: An overlooked learning opportunitycited by 56
  7. 2020Admissible anytime-valid sequential inference must rely on nonnegative martingalescited by 48
  8. 2019Universal Inferencecited by 44
  9. 2023Model-free selective inference under covariate shift via weighted conformal p-valuescited by 29
  10. 2020Confidence sequences for sampling without replacementcited by 23
  11. 2016Online Rules for Control of False Discovery Rate and False Discovery Exceedancecited by 21
  12. 2020A Two-Sample Conditional Distribution Test Using Conformal Prediction and Weighted Rank Sumcited by 19
24 more
  1. 2017A framework for Multi-A(rmed)/B(andit) testing with online FDR controlcited by 17
  2. 2022Post-selection inference for e-value based confidence intervalscited by 14
  3. 2022Derandomized knockoffs: leveraging e-values for false discovery rate controlcited by 12
  4. 2017Online control of the false discovery rate with decaying memorycited by 11
  5. 2018SAFFRON: an adaptive algorithm for online control of the false discovery ratecited by 11
  6. 2019Online Control of the False Coverage Rate and False Sign Ratecited by 11
  7. 2019ADDIS: an adaptive discarding algorithm for online FDR control with conservative nullscited by 11
  8. 2018Asynchronous Online Testing of Multiple Hypothesescited by 10
  9. 2021A unified framework for bandit multiple testingcited by 8
  10. 2019Online control of the familywise error ratecited by 7
  11. 2015On Online Control of False Discovery Ratecited by 6
  12. 2019The Power of Batching in Multiple Hypothesis Testingcited by 4
  13. 2021Universal Inference Meets Random Projections: A Scalable Test for Log-concavitycited by 3
  14. 2022E-values as unnormalized weights in multiple testingcited by 3
  15. 2022Near-optimal multiple testing in Bayesian linear models with finite-sample FDR controlcited by 3
  16. 2023More powerful multiple testing under dependence via randomizationcited by 3
  17. 2021Online multiple testing with super-uniformity rewardcited by 2
  18. 2021Online control of the False Discovery Rate in group-sequential platform trialscited by 2
  19. 2018Online control of the false discovery rate in biomedical researchcited by 1
  20. 2021Online Control of the False Discovery Rate under "Decision Deadlines"cited by 1
  21. 2021Online False Discovery Rate Control for LORD & SAFFRON Under Positive, Local Dependencecited by 1
  22. 2022Online error control for platform trialscited by 1
  23. 2023A Sequential Test for Log-Concavitycited by 1
  24. 2023An exhaustive ADDIS principle for online FWER controlcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 6.

12 papers.