Mallows Model with Learned Distance Metrics: Sampling and Maximum Likelihood Estimation
Not on the map. Why?
Abstract (arXiv)
textitMallows model is a widely-used probabilistic framework for learning from ranking data, with applications ranging from recommendation systems and voting to aligning language models with human preferences~citechen2024mallows, kleinberg2021algorithmic, rafailov2024direct. Under this model, observed rankings are noisy perturbations of a central ranking σ, with likelihood decaying exponentially in distance from σ, i.e, P (π) propto expbig(-β · d(π, σ)big), where β > 0 controls dispersion and d is a distance function. Existing methods mainly focus on fixed distances (such as Kendall's τ distance), with no principled approach to learning the distance metric directly from data. In practice, however, rankings naturally vary by context; for instance, in some sports we regularly see long-range swaps (a low-rank team beating a high-rank one), while in others such events are rare. Motivated by this, we propose a generalization of Mallows model that learns the distance metric directly from data. Specifically, we focus on Lα distances: dα(π,σ):=sumi=1 |π(i)-σ(i)|α. For any α≥ 1 and β>0, we develop a Fully Polynomial-Time Approximation Scheme (FPTAS) to efficiently generate samples that are ε- close (in total variation distance) to the true distribution. Even in the special cases of L1 and L2, this generalizes prior results that required vanishing dispersion (β→0). Using this sampling algorithm, we propose an efficient Maximum Likelihood Estimation (MLE) algorithm that jointly estimates the central ranking, the dispersion parameter, and the optimal distance metric. We prove strong consistency results for our estimators (for any values of α and β), and we validate our approach empirically using datasets from sports rankings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 48 references that are in the map. First posted on arXiv 10 Jul 2025.
Builds on
11 of 48 references.
References · 11
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2014A* Samplingcited by 151
- 2021Algorithmic Monoculture and Social Welfarecited by 100
- 2015Simple, Robust and Optimal Ranking from Pairwise Comparisonscited by 70
- 2024MallowsPO: Fine-Tune Your LLM with Preference Dispersionscited by 18
- 2018Efficiently Learning Mixtures of Mallows Modelscited by 13
- 2019Optimal Learning of Mallows Block Modelcited by 12
- 2022A Bayesian Bradley-Terry model to compare multiple ML algorithms on multiple data setscited by 9
- 2020Learning Mixtures of Permutations: Groups of Pairwise Comparisons and Combinatorial Method of Momentscited by 6
- 2022On A Mallows-type Model For (Ranked) Choicescited by 4
- 2020FPRAS Approximation of the Matrix Permanent in Practicecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022Ranking Inferences Based on the Top Choice of Multiway Comparisons
- 2026Prompt-Dependent Ranking of Large Language Models with Uncertainty Quantification
- 2026Population-Level Generative Modeling for Ranking Data
- 2017Spectral Method and Regularized MLE Are Both Optimal for Top-K Ranking
- 2026Ranking Reasoning LLMs under Test-Time Scaling
- 2021Lagrangian Inference for Ranking Problems
- 2019Rank Aggregation via Heterogeneous Thurstone Preference Models
- 2026Nonparametric LLM Evaluation from Preference Data