mlsanityData to 7 Oct 2026

Locally minimax optimal confidence sets for the best model

arXiv 2503.21639 ↗First posted 27 Mar 2025math.ST stat.ME stat.MLcited by 2

Not on the map. Why?

Abstract (arXiv)

This paper tackles a fundamental inference problem: given n observations from a distribution P over ℝd with unknown mean boldsymbolμ, we must form a confidence set for the index (or indices) corresponding to the smallest component of boldsymbolμ. By duality, we reduce this to testing, for each r in 1,ldots,d, whether μr is the smallest. Based on the sample splitting and self-normalization approach of Kim and Ramdas (2024), we propose "dimension-agnostic" tests that maintain validity regardless of how d scales with n, and regardless of arbitrary ties in boldsymbolμ. Notably, our validity holds under mild moment conditions, requiring little more than finiteness of a second moment, and permitting possibly strong dependence between coordinates. In addition, we establish the local minimax separation rate for this problem, which adapts to the cardinality of a confusion set, and show that the proposed tests attain this rate. Furthermore, we develop robust variants that continue to achieve the same minimax rate under heavy-tailed distributions with only finite second moments. While these results highlight the theoretical strength of our method, a practical concern is that sample splitting can reduce finite-sample power. We show that this drawback can be substantially alleviated by the multi-split aggregation method of Guo and Shah (2025). Finally, empirical results on simulated and real data illustrate the strong performance of our approach in terms of type I error control and power compared to existing methods.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 49 references that are in the map. First posted on arXiv 27 Mar 2025.

Builds on

17 of 49 references.

References · 17

  1. 2013Loss minimization and parameter estimation with heavy tailscited by 50
  2. 2017Sub-Gaussian estimators of the mean of a random vectorcited by 47
  3. 2022Ranking Inferences Based on the Top Choice of Multiway Comparisonscited by 22
  4. 2022A Permutation-free Kernel Two-Sample Testcited by 21
  5. 2022The Projected Covariance Measure for assumption-lean variable significance testingcited by 16
  6. 2020Dimension-agnostic inference using cross U-statisticscited by 14
  7. 2016Rank Verification for Exponential Familiescited by 13
  8. 2022A Permutation-Free Kernel Independence Testcited by 11
  9. 2023An Efficient Doubly-Robust Test for the Kernel Treatment Effectcited by 10
  10. 2024Winners with Confidence: Discrete Argmin Inference with an Application to Model Selectioncited by 7
  11. 2023Rank-transformed subsampling: inference for multiple data splitting and exchangeable p-valuescited by 5
  12. 2021Multiple-Splitting Projection Test for High-Dimensional Mean Vectorscited by 4
5 more
  1. 2024Sequential model confidence setscited by 3
  2. 2024Selective inference is easier with p-valuescited by 2
  3. 2025Powerful rank verification for multivariate Gaussian data with any covariance structurecited by 2
  4. 2023Dimension-agnostic Change Point Detectioncited by 1
  5. 2025Gaussian Rank Verificationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.