Uncertainty quantification in the Bradley-Terry-Luce model
Not on the map. Why?
Abstract (arXiv)
The Bradley-Terry-Luce (BTL) model is a benchmark model for pairwise comparisons between individuals. Despite recent progress on the first-order asymptotics of several popular procedures, the understanding of uncertainty quantification in the BTL model remains largely incomplete, especially when the underlying comparison graph is sparse. In this paper, we fill this gap by focusing on two estimators that have received much recent attention: the maximum likelihood estimator (MLE) and the spectral estimator. Using a unified proof strategy, we derive sharp and uniform non-asymptotic expansions for both estimators in the sparsest possible regime (up to some poly-logarithmic factors) of the underlying comparison graph. These expansions allow us to obtain: (i) finite-dimensional central limit theorems for both estimators; (ii) construction of confidence intervals for individual ranks; (iii) optimal constant of ℓ2 estimation, which is achieved by the MLE but not by the spectral estimator. Our proof is based on a self-consistent equation of the second-order remainder vector and a novel leave-two-out analysis.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 11 of its 47 references that are in the map. First posted on arXiv 8 Oct 2021.
Builds on
11 of 47 references.
References · 11
- 2015An Introduction to Matrix Concentration Inequalitiescited by 397
- 2018A modern maximum-likelihood theory for high-dimensional logistic regressioncited by 81
- 2013Confidence Intervals and Hypothesis Testing for High-Dimensional Regressioncited by 79
- 2018Deep Neural Networks for Estimation and Inferencecited by 62
- 2017Spectral Method and Regularized MLE Are Both Optimal for Top-K Rankingcited by 47
- 2019Inference and Uncertainty Quantification for Noisy Matrix Completioncited by 39
- 2015Spectral MLE: Top-K Rank Aggregation from Pairwise Comparisonscited by 34
- 2014A General Theory of Hypothesis Tests and Confidence Regions for Sparse High Dimensional Modelscited by 26
- 2021Optimal Full Ranking from Pairwise Comparisonscited by 16
- 2013Asymptotic normality and optimalities in estimation of large Gaussian graphical modelscited by 12
- 2015A Unified Theory of Confidence Regions and Testing for High Dimensional Estimating Equationscited by 5
Built on by
Citing papers per year: 2022: 2; 2023: 5; 2024: 5; 2025: 6; 2026: 11.
29 papers.
Sort:
By area:
- 2022Ranking Inferences Based on the Top Choice of Multiway Comparisonscited by 22
- 2022Uncertainty Quantification of MLE for Entity Ranking with Covariatescited by 16
- 2023Spectral Ranking Inferences based on General Multiway Comparisonscited by 11
- 2025Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankingscited by 8
- 2025Estimating Semantic Alphabet Size for LLM Uncertainty Quantificationcited by 8
- 2025Contextual Online Uncertainty-Aware Preference Learning for Human Feedbackcited by 7
- 2026A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground Truthcited by 7
- 2023Ranking from Pairwise Comparisons in General Graphs and Graphs with Localitycited by 6
- 2024Statistical ranking with dynamic covariatescited by 6
- 2026Prompt-Dependent Ranking of Large Language Models with Uncertainty Quantificationcited by 4
- 2026Reinforcement Learning from Human Feedback: A Statistical Perspectivecited by 4
- 2024Statistical inference for pairwise comparison modelscited by 3
17 more
- 2024Top-K ranking with a monotone adversarycited by 3
- 2024Minimax Hypothesis Testing for the Bradley-Terry-Luce Modelcited by 3
- 2026What Does Preference Learning Recover from Pairwise Comparison Data?cited by 3
- 2023Improved theoretical guarantee for rank aggregation via spectral methodcited by 2
- 2025Transductive Conformal Inference for Full Rankingcited by 2
- 2026A Unified Perturbation Framework for Analyzing Leaderboard Stability and Manipulationcited by 2
- 2023Combinatorial Inference on the Optimal Assortment in Multinomial Logit Modelscited by 1
- 2023Inferences on Mixing Probabilities and Ranking in Mixed-Membership Modelscited by 1
- 2025Hypothesis Testing for Generalized Thurstone Modelscited by 1
- 2026Entrywise Error Bounds for Spectral Ranking with Semi-Random Adversariescited by 1
- 2026Convergence analysis of a family of Zermelo-type iterations for the Bradley--Terry modelcited by 1
- 2024Random pairing MLE for estimation of item parameters in Rasch modelcited by 0
- 2025Preference-Based Dynamic Ranking Structure Recognitioncited by 0
- 2026Privacy utility trade offs for parameter estimation in degree heterogeneous higher order networkscited by 0
- 2026The Trust Paradox: How CS Researchers Engage LLM Leaderboardscited by 0
- 2026Bradley-Terry Rankings for Recommender Systems Across Dataset Taxonomiescited by 0
- 2026Bradley-Terry model under general comparison graphscited by 0
- 2026Bradley-Terry model under general comparison graphs5 Oct 2026
- 2026Convergence analysis of a family of Zermelo-type iterations for the Bradley--Terry model24 Jul 2026
- 2026Bradley-Terry Rankings for Recommender Systems Across Dataset Taxonomies5 Jun 2026
- 2026The Trust Paradox: How CS Researchers Engage LLM Leaderboards27 May 2026
- 2026Entrywise Error Bounds for Spectral Ranking with Semi-Random Adversaries22 May 2026
- 2026A Unified Perturbation Framework for Analyzing Leaderboard Stability and Manipulation15 May 2026
- 2026Reinforcement Learning from Human Feedback: A Statistical Perspective2 Apr 2026
- 2026Prompt-Dependent Ranking of Large Language Models with Uncertainty Quantification11 Feb 2026
- 2026What Does Preference Learning Recover from Pairwise Comparison Data?10 Feb 2026
- 2026Privacy utility trade offs for parameter estimation in degree heterogeneous higher order networks3 Feb 2026
- 2026A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground Truth29 Jan 2026
- 2025Hypothesis Testing for Generalized Thurstone Models2 Dec 2025
17 more
- 2025Preference-Based Dynamic Ranking Structure Recognition29 Sep 2025
- 2025Estimating Semantic Alphabet Size for LLM Uncertainty Quantification17 Sep 2025
- 2025Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings16 Aug 2025
- 2025Contextual Online Uncertainty-Aware Preference Learning for Human Feedback27 Apr 2025
- 2025Transductive Conformal Inference for Full Ranking20 Jan 2025
- 2024Minimax Hypothesis Testing for the Bradley-Terry-Luce Model10 Oct 2024
- 2024Statistical ranking with dynamic covariates24 Jun 2024
- 2024Random pairing MLE for estimation of item parameters in Rasch model20 Jun 2024
- 2024Top-K ranking with a monotone adversary12 Feb 2024
- 2024Statistical inference for pairwise comparison models16 Jan 2024
- 2023Improved theoretical guarantee for rank aggregation via spectral method7 Sep 2023
- 2023Inferences on Mixing Probabilities and Ranking in Mixed-Membership Models29 Aug 2023
- 2023Spectral Ranking Inferences based on General Multiway Comparisons5 Aug 2023
- 2023Ranking from Pairwise Comparisons in General Graphs and Graphs with Locality13 Apr 2023
- 2023Combinatorial Inference on the Optimal Assortment in Multinomial Logit Models28 Jan 2023
- 2022Uncertainty Quantification of MLE for Entity Ranking with Covariates20 Dec 2022
- 2022Ranking Inferences Based on the Top Choice of Multiway Comparisons22 Nov 2022
- 2025Contextual Online Uncertainty-Aware Preference Learning for Human Feedbackcited by 7
- 2026Prompt-Dependent Ranking of Large Language Models with Uncertainty Quantificationcited by 4
- 2026Reinforcement Learning from Human Feedback: A Statistical Perspectivecited by 4
- 2026What Does Preference Learning Recover from Pairwise Comparison Data?cited by 3
- 2026Bradley-Terry model under general comparison graphscited by 0
- 2026Bradley-Terry model under general comparison graphs5 Oct 2026
- 2026Reinforcement Learning from Human Feedback: A Statistical Perspective2 Apr 2026
- 2026Prompt-Dependent Ranking of Large Language Models with Uncertainty Quantification11 Feb 2026
- 2026What Does Preference Learning Recover from Pairwise Comparison Data?10 Feb 2026
- 2025Contextual Online Uncertainty-Aware Preference Learning for Human Feedback27 Apr 2025
- 2022Ranking Inferences Based on the Top Choice of Multiway Comparisonscited by 22
- 2022Uncertainty Quantification of MLE for Entity Ranking with Covariatescited by 16
- 2023Spectral Ranking Inferences based on General Multiway Comparisonscited by 11
- 2025Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankingscited by 8
- 2025Estimating Semantic Alphabet Size for LLM Uncertainty Quantificationcited by 8
- 2026A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground Truthcited by 7
- 2023Ranking from Pairwise Comparisons in General Graphs and Graphs with Localitycited by 6
- 2024Statistical ranking with dynamic covariatescited by 6
- 2024Statistical inference for pairwise comparison modelscited by 3
- 2024Top-K ranking with a monotone adversarycited by 3
- 2024Minimax Hypothesis Testing for the Bradley-Terry-Luce Modelcited by 3
- 2023Improved theoretical guarantee for rank aggregation via spectral methodcited by 2
12 most cited of 24 All 24 (JSON)
- 2026Convergence analysis of a family of Zermelo-type iterations for the Bradley--Terry model24 Jul 2026
- 2026Bradley-Terry Rankings for Recommender Systems Across Dataset Taxonomies5 Jun 2026
- 2026The Trust Paradox: How CS Researchers Engage LLM Leaderboards27 May 2026
- 2026Entrywise Error Bounds for Spectral Ranking with Semi-Random Adversaries22 May 2026
- 2026A Unified Perturbation Framework for Analyzing Leaderboard Stability and Manipulation15 May 2026
- 2026Privacy utility trade offs for parameter estimation in degree heterogeneous higher order networks3 Feb 2026
- 2026A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground Truth29 Jan 2026
- 2025Hypothesis Testing for Generalized Thurstone Models2 Dec 2025
- 2025Preference-Based Dynamic Ranking Structure Recognition29 Sep 2025
- 2025Estimating Semantic Alphabet Size for LLM Uncertainty Quantification17 Sep 2025
- 2025Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings16 Aug 2025
- 2025Transductive Conformal Inference for Full Ranking20 Jan 2025
12 newest of 24 All 24 (JSON)