Virtual Dummies: Enabling Scalable FDR-Controlled Variable Selection via Sequential Sampling of Null Features
Not on the map. Why?
Abstract (arXiv)
High-dimensional variable selection, particularly in genomics, requires error-controlling procedures that scale to millions of predictors. The Terminating-Random Experiments (T-Rex) selector achieves false discovery rate (FDR) control by aggregating results of early terminated random experiments, each combining original predictors with i.i.d. synthetic null variables (dummies). At biobank scales, however, explicit dummy augmentation requires terabytes of memory. We demonstrate that this bottleneck is not fundamental. Formalizing the information flow of forward selection through a filtration, we show that compatible selectors interact with unselected dummies solely through projections onto an adaptively evolving low-dimensional subspace. For rotationally invariant dummy distributions, we derive an adaptive stick-breaking construction sampling these projections from their exact conditional distribution given the selection history, thereby eliminating dummy matrix materialization. We prove a pathwise universality theorem: under mild delocalization conditions, selection paths driven by generic standardized i.i.d. dummies converge to the same Gaussian limit. We instantiate the theory through Virtual Dummy LARS (VD-LARS), reducing memory and runtime by several orders of magnitude while preserving the exact selection law and FDR guarantees of the T-Rex selector. Experiments on realistic genome-wide association study data confirm that VD-T-Rex controls FDR and achieves power at scales where all competing methods either fail or time out.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 56 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
21 of 56 references.
References · 21
- 2016Panning for Gold: Model-X Knockoffs for High-dimensional Controlled Variable Selectioncited by 120
- 2014Controlling the false discovery rate via knockoffscited by 97
- 2018Deep Knockoffscited by 40
- 2015False Discoveries Occur Early on the Lasso Pathcited by 31
- 2016A knockoff filter for high-dimensional selective inferencecited by 25
- 2022Derandomized knockoffs: leveraging e-values for false discovery rate controlcited by 12
- 2014A General Framework for Fast Stagewise Algorithmscited by 11
- 2016The knockoff filter for FDR control in group-sparse and multitask regressioncited by 11
- 2019Metropolized Knockoff Samplingcited by 10
- 2019Controlling False Discovery Rate Using Gaussian Mirrorscited by 10
- 2021The Terminating-Random Experiments Selector: Fast High-Dimensional Variable Selection with False Discovery Rate Controlcited by 10
- 2020Derandomizing Knockoffscited by 9
9 more
- 2020Powerful Knockoffs via Minimizing Reconstructabilitycited by 6
- 2024FDR-Controlled Portfolio Optimization for Sparse Financial Index Trackingcited by 5
- 2022Outlier Robust and Sparse Estimation of Linear Regression Coefficientscited by 4
- 2024Sparse PCA with False Discovery Rate Controlled Variable Selectioncited by 4
- 2024False Discovery Rate Control for Gaussian Graphical Models via Neighborhood Screeningcited by 3
- 2024High-Dimensional False Discovery Rate Control for Dependent Variablescited by 3
- 2024Solving FDR-Controlled Sparse Regression Problems with Five Million Variables on a Laptopcited by 2
- 2020FANOK: Knockoffs in Linear Timecited by 1
- 2024The Informed Elastic Net for Fast Grouped Variable Selection and FDR Control in Genomics Researchcited by 1
Built on by
Not cited yet.