# On the exact Berk-Jones statistics and their p-value calculation

arXiv: https://arxiv.org/abs/1311.3190 · HTML: https://mlsanity.com/paper/1311.3190/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Nov 2013.

## Built on by (most cited first, 5 of 5)

- [Quantile Risk Control: A Flexible Framework for Bounding the Probability of High-Loss Predictions](https://mlsanity.com/paper/2212.13629/) (2022)
- [Distribution-Free Statistical Dispersion Control for Societal Applications](https://mlsanity.com/paper/2309.13786/) (2023)
- [An Information-Theoretic Approach for Detecting Edits in AI-Generated Text](https://mlsanity.com/paper/2308.12747/) (2023)
- [Asymptotically Optimal Pure Exploration for Infinite-Armed Bandits](https://mlsanity.com/paper/2306.01995/) (2023)
- [Occupancy-based Quantile Risk Control](https://mlsanity.com/paper/2609.03104/) (2026)

## Abstract (arXiv)

Continuous goodness-of-fit testing is a classical problem in statistics. Despite having low power for detecting deviations at the tail of a distribution, the most popular test is based on the Kolmogorov-Smirnov statistic. While similar variance-weighted statistics, such as Anderson-Darling and the Higher Criticism statistic give more weight to tail deviations, as shown in various works, they still mishandle the extreme tails. As a viable alternative, in this paper we study some of the statistical properties of the exact Mn statistics of Berk and Jones. We derive the asymptotic null distributions of Mn, Mn^+, Mn^-, and further prove their consistency as well as asymptotic optimality for a wide range of rare-weak mixture models. Additionally, we present a new computationally efficient method to calculate p-values for any supremum-based one-sided statistic, including the one-sided Mn^+,Mn^- and Rn^+,Rn^- statistics of Berk and Jones and the Higher Criticism statistic. We illustrate our theoretical analysis with several finite-sample simulations.