Anytime-valid t-tests and confidence sequences for Gaussian means with unknown variance
Not on the map. Why?
Abstract (arXiv)
In 1976, Lai constructed a nontrivial confidence sequence for the mean μ of a Gaussian distribution with unknown variance σ2. Curiously, he employed both an improper (right Haar) mixture over σ and an improper (flat) mixture over μ. Here, we elaborate carefully on the details of his construction, which use generalized nonintegrable martingales and an extended Ville's inequality. While this does yield a sequential t-test, it does not yield an "e-process" (due to the nonintegrability of his martingale). In this paper, we develop two new e-processes and confidence sequences for the same setting: one is a test martingale in a reduced filtration, while the other is an e-process in the canonical data filtration. These are respectively obtained by swapping Lai's flat mixture for a Gaussian mixture, and swapping the right Haar mixture over σ with the maximum likelihood estimate under the null, as done in universal inference. We also analyze the width of resulting confidence sequences, which have a curious polynomial dependence on the error probability α that we prove to be not only unavoidable, but (for universal inference) even better than the classical fixed-sample t-test. Numerical experiments are provided along the way to compare and contrast the various approaches, including some recent suboptimal ones.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 48 references that are in the map. First posted on arXiv 5 Oct 2023.
Builds on
18 of 48 references.
References · 18
- 2014On the Complexity of Best Arm Identification in Multi-Armed Bandit Modelscited by 286
- 2018Time-uniform, nonparametric, nonasymptotic confidence sequencescited by 229
- 2020Estimating means of bounded random variables by bettingcited by 169
- 2019Safe Testingcited by 101
- 2016Explore First, Exploit Next: The True Shape of Regret in Bandit Problemscited by 79
- 2019Universal Inferencecited by 44
- 2021Testing exchangeability: fork-convexity, supermartingales, and e-processescited by 32
- 2021Time-uniform central limit theory and asymptotic confidence sequencescited by 29
- 2019Sequential estimation of quantiles with applications to A/B-testing and best-arm identificationcited by 27
- 2022Catoni-style confidence sequences for heavy-tailed mean estimationcited by 17
- 2023Randomized and Exchangeable Improvements of Markov's, Chebyshev's and Chernoff's Inequalitiescited by 15
- 2022Dealing with Unknown Variances in Best-Arm Identificationcited by 13
6 more
- 2022A composite generalization of Ville's martingale theorem using e-processescited by 10
- 2021A unified framework for bandit multiple testingcited by 8
- 2022E-Statistics, Group Invariance and Anytime Valid Testingcited by 8
- 2022Anytime-Valid Linear Models and Regression Adjusted Causal Inference in Randomized Experimentscited by 4
- 2022Efficiency of nonparametric e-testscited by 3
- 2023The extended Ville's inequality for nonintegrable nonnegative supermartingalescited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.
- 2025E-valuator: Reliable Agent Verifiers with Sequential Hypothesis Testingcited by 17
- 2024High-probability minimax lower boundscited by 13
- 2025E-valuator: Reliable Agent Verifiers with Sequential Hypothesis Testing2 Dec 2025
- 2024High-probability minimax lower bounds19 Jun 2024