Preference-Based Dynamic Ranking Structure Recognition
Not on the map. Why?
Abstract (arXiv)
Preference-based data often appear complex and noisy but may conceal underlying homogeneous structures. This paper introduces a novel framework of ranking structure recognition for preference-based data. We first develop an approach to identify dynamic ranking groups by incorporating temporal penalties into a spectral estimation for the celebrated Bradley-Terry model. To detect structural changes, we introduce an innovative objective function and present a practicable algorithm based on dynamic programming. Theoretically, we establish the consistency of ranking group recognition by exploiting properties of a random `design matrix' induced by a reversible Markov chain. We also tailor a group inverse technique to quantify the uncertainty in item ability estimates. Additionally, we prove the consistency of structure change recognition, ensuring the robustness of the proposed framework. Experiments on both synthetic and real-world datasets demonstrate the practical utility and interpretability of our approach.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 45 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
14 of 45 references.
References · 14
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraintcited by 350
- 2023Principled Reinforcement Learning with Human Feedback from Pairwise or K-wise Comparisonscited by 247
- 2020Spectral Methods for Data Science: A Statistical Perspectivecited by 112
- 2024Provable Pluralistic Alignment: Multi-Party RLHF under Offline Human Feedbackcited by 32
- 2021Uncertainty quantification in the Bradley-Terry-Luce modelcited by 29
- 2021Lagrangian Inference for Ranking Problemscited by 19
- 2022sparsegl: An R Package for Estimating Sparse Group Lassocited by 9
- 2020Nonparametric Estimation in the Dynamic Bradley-Terry Modelcited by 8
- 2025Contextual Online Uncertainty-Aware Preference Learning for Human Feedbackcited by 7
- 2021Dynamic Ranking with the BTL Model: A Nearest Neighbor based Rank Centrality Methodcited by 5
- 2016CLEAR: Covariant LEAst-square Re-fitting with applications to image restorationcited by 4
2 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2017Inductive Pairwise Ranking: Going Beyond the n log(n) Barrier
- 2017Spectral Method and Regularized MLE Are Both Optimal for Top-K Ranking
- 2025When Less Is More: Binary Feedback Can Outperform Ordinal Comparisons in Ranking Recovery
- 2018Ranking with Features: Algorithm and A Graph Theoretic Analysis ↗
- 2023Spectral Ranking Inferences based on General Multiway Comparisons
- 2025SP-Rank: A Dataset for Ranked Preferences with Secondary Information
- 2019Rank Aggregation via Heterogeneous Thurstone Preference Models
- 2026How Many Repeated Pairwise Comparisons Are Needed for Ranking under Heterogeneity?