mlsanityData to 14 Oct 2026

Ranking Inferences Based on the Top Choice of Multiway Comparisons

arXiv 2211.11957 ↗First posted 22 Nov 2022stat.ME cs.IT math.ITcited by 22

Not on the map. Why?

Abstract (arXiv)

This paper considers ranking inference of n items based on the observed data on the top choice among M randomly selected items at each trial. This is a useful modification of the Plackett-Luce model for M-way ranking with only the top choice observed and is an extension of the celebrated Bradley-Terry-Luce model that corresponds to M=2. Under a uniform sampling scheme in which any M distinguished items are selected for comparisons with probability p and the selected M items are compared L times with multinomial outcomes, we establish the statistical rates of convergence for underlying n preference scores using both ℓ2-norm and ℓ_∞-norm, with the minimum sampling complexity. In addition, we establish the asymptotic normality of the maximum likelihood estimator that allows us to construct confidence intervals for the underlying scores. Furthermore, we propose a novel inference framework for ranking items through a sophisticated maximum pairwise difference statistic whose distribution is estimated via a valid Gaussian multiplier bootstrap. The estimated distribution is then used to construct simultaneous confidence intervals for the differences in the preference scores and the ranks of individual items. They also enable us to address various inference questions on the ranks of these items. Extensive simulation studies lend further support to our theoretical results. A real data application illustrates the usefulness of the proposed methods convincingly.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 5 of its 46 references that are in the map. First posted on arXiv 22 Nov 2022.

Builds on

5 of 46 references.

References · 5

  1. 2017Spectral Method and Regularized MLE Are Both Optimal for Top-K Rankingcited by 47
  2. 2021Uncertainty quantification in the Bradley-Terry-Luce modelcited by 29
  3. 2021Lagrangian Inference for Ranking Problemscited by 19
  4. 2015High-dimensional Ordinary Least-squares Projection for Screening Variablescited by 12
  5. 2022Are Latent Factor Regression and Sparse Regression Adequate?cited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 2; 2024: 7; 2025: 6; 2026: 6.

22 papers.

Sort:

By area:

  1. 2022Uncertainty Quantification of MLE for Entity Ranking with Covariatescited by 16
  2. 2023Spectral Ranking Inferences based on General Multiway Comparisonscited by 11
  3. 2024The ICML 2023 Ranking Experiment: Examining Author Self-Assessment in ML/AI Peer Reviewcited by 8
  4. 2025Contextual Online Uncertainty-Aware Preference Learning for Human Feedbackcited by 7
  5. 2024Statistical ranking with dynamic covariatescited by 6
  6. 2024Rethinking Human Evaluation Protocol for Text-to-Video Models: Enhancing Reliability,Reproducibility, and Practicalitycited by 4
  7. 2026Prompt-Dependent Ranking of Large Language Models with Uncertainty Quantificationcited by 4
  8. 2026Reinforcement Learning from Human Feedback: A Statistical Perspectivecited by 4
  9. 2024Statistical inference for pairwise comparison modelscited by 3
  10. 2024Top-K ranking with a monotone adversarycited by 3
  11. 2024Minimax Hypothesis Testing for the Bradley-Terry-Luce Modelcited by 3
  12. 2025Locally minimax optimal confidence sets for the best modelcited by 3
10 more
  1. 2025Transductive Conformal Inference for Full Rankingcited by 2
  2. 2026Perturbation is All You Need for Extrapolating Language Modelscited by 2
  3. 2023Inferences on Mixing Probabilities and Ranking in Mixed-Membership Modelscited by 1
  4. 2025Statistical Inference for Generative Model Comparisoncited by 1
  5. 2026Entrywise Error Bounds for Spectral Ranking with Semi-Random Adversariescited by 1
  6. 2026Anytime-Valid LLM Leaderboards via Benchmark-weighted and Block-Factorized e-Processescited by 1
  7. 2024Random pairing MLE for estimation of item parameters in Rasch modelcited by 0
  8. 2025GEM: Generative Entropy-Guided Preference Modeling for Few-shot Alignment of LLMscited by 0
  9. 2025Reliable Selection of Heterogeneous Treatment Effect Estimatorscited by 0
  10. 2026Population-Level Generative Modeling for Ranking Datacited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026How Many Repeated Pairwise Comparisons Are Needed for Ranking under Heterogeneity?
  2. 2026Ranking Reasoning LLMs under Test-Time Scaling
  3. 2026MoPLEx: Estimating Plackett-Luce Mixture Models for Multi-Objective Alignment
  4. 2025When Less Is More: Binary Feedback Can Outperform Ordinal Comparisons in Ranking Recovery
  5. 2025SP-Rank: A Dataset for Ranked Preferences with Secondary Information
  6. 2019Rank Aggregation via Heterogeneous Thurstone Preference Models
  7. 2017Inductive Pairwise Ranking: Going Beyond the n log(n) Barrier
  8. 2026Bradley-Terry model under general comparison graphs