Locally minimax optimal confidence sets for the best model
Not on the map. Why?
Abstract (arXiv)
This paper tackles a fundamental inference problem: given n observations from a distribution P over ℝd with unknown mean boldsymbolμ, we must form a confidence set for the index (or indices) corresponding to the smallest component of boldsymbolμ. By duality, we reduce this to testing, for each r in 1,ldots,d, whether μr is the smallest. Based on the sample splitting and self-normalization approach of Kim and Ramdas (2024), we propose "dimension-agnostic" tests that maintain validity regardless of how d scales with n, and regardless of arbitrary ties in boldsymbolμ. Notably, our validity holds under mild moment conditions, requiring little more than finiteness of a second moment, and permitting possibly strong dependence between coordinates. In addition, we establish the local minimax separation rate for this problem, which adapts to the cardinality of a confusion set, and show that the proposed tests attain this rate. Furthermore, we develop robust variants that continue to achieve the same minimax rate under heavy-tailed distributions with only finite second moments. While these results highlight the theoretical strength of our method, a practical concern is that sample splitting can reduce finite-sample power. We show that this drawback can be substantially alleviated by the multi-split aggregation method of Guo and Shah (2025). Finally, empirical results on simulated and real data illustrate the strong performance of our approach in terms of type I error control and power compared to existing methods.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 49 references that are in the map. First posted on arXiv 27 Mar 2025.
Builds on
17 of 49 references.
References · 17
- 2013Loss minimization and parameter estimation with heavy tailscited by 50
- 2017Sub-Gaussian estimators of the mean of a random vectorcited by 47
- 2022Ranking Inferences Based on the Top Choice of Multiway Comparisonscited by 22
- 2022A Permutation-free Kernel Two-Sample Testcited by 21
- 2022The Projected Covariance Measure for assumption-lean variable significance testingcited by 16
- 2020Dimension-agnostic inference using cross U-statisticscited by 14
- 2016Rank Verification for Exponential Familiescited by 13
- 2022A Permutation-Free Kernel Independence Testcited by 11
- 2023An Efficient Doubly-Robust Test for the Kernel Treatment Effectcited by 10
- 2024Winners with Confidence: Discrete Argmin Inference with an Application to Model Selectioncited by 7
- 2023Rank-transformed subsampling: inference for multiple data splitting and exchangeable p-valuescited by 5
- 2021Multiple-Splitting Projection Test for High-Dimensional Mean Vectorscited by 4
5 more
- 2024Sequential model confidence setscited by 3
- 2024Selective inference is easier with p-valuescited by 2
- 2025Powerful rank verification for multivariate Gaussian data with any covariance structurecited by 2
- 2023Dimension-agnostic Change Point Detectioncited by 1
- 2025Gaussian Rank Verificationcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.