Uncertainty Quantification for Ranking with Heterogeneous Preferences
Not on the map. Why?
Abstract (arXiv)
This paper studies human preference learning based on partially revealed choice behavior and formulates the problem as a generalized Bradley-Terry-Luce (BTL) ranking model that accounts for heterogeneous preferences. Specifically, we assume that each user is associated with a nonparametric preference function, and each item is characterized by a low-dimensional latent feature vector - their interaction defines the underlying low-rank score matrix. In this formulation, we propose an indirect regularization method for collaboratively learning the score matrix, which ensures entrywise ℓ_∞-norm error control - a novel contribution to the heterogeneous preference learning literature. This technique is based on sieve approximation and can be extended to a broader class of binary choice models where a smooth link function is adopted. In addition, by applying a single step of the Newton-Raphson method, we debias the regularized estimator and establish uncertainty quantification for item scores and rankings of items, both for the aggregated and individual preferences. Extensive simulation results from synthetic and real datasets corroborate our theoretical findings.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Sep 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025Uncertainty Quantification for Large Language Model Reward Learning under Heterogeneous Human Feedbackcited by 9
- 2026A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground Truthcited by 7
- 2026LLM Evaluation as Tensor Completion: Low Rank Structure and Semiparametric Efficiencycited by 3
- 2026Perturbation is All You Need for Extrapolating Language Modelscited by 2
- 2026Low Rank for Rank: Uncertainty-Aware Task-Specific LLM Ranking under Sparse Pairwise Comparisonscited by 2
- 2026Maximum Likelihood Estimation for Entity Ranking under Iterative Synthetic Data Augmentationcited by 1
- 2026Maximum Likelihood Estimation for Entity Ranking under Iterative Synthetic Data Augmentation26 Sep 2026
- 2026Low Rank for Rank: Uncertainty-Aware Task-Specific LLM Ranking under Sparse Pairwise Comparisons28 May 2026
- 2026Perturbation is All You Need for Extrapolating Language Models5 May 2026
- 2026LLM Evaluation as Tensor Completion: Low Rank Structure and Semiparametric Efficiency7 Apr 2026
- 2026A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground Truth29 Jan 2026
- 2025Uncertainty Quantification for Large Language Model Reward Learning under Heterogeneous Human Feedback2 Dec 2025