Generalized Priority-Aware Shapley Value
Not on the map. Why?
Abstract (arXiv)
Shapley value and its priority-aware extensions are widely used for valuation in machine learning, but existing methods require pairwise priority to be binary and acyclic, a restriction spectacularly violated in real-data examples such as aggregated human preferences and multi-criterion comparisons. We introduce the generalized priority-aware Shapley value (GPASV), a random order value defined on arbitrary directed weighted priority graphs, in which pairwise edges penalize rather than forbid order violations. GPASV covers a range of classical models as boundary cases. We establish GPASV through an axiomatic characterization, develop the associated computational methods, and introduce a priority sweeping diagnostic extending PASV's. We apply GPASV to LLM ensemble valuation on the cyclic Chatbot Arena preference graph, illustrating that priority-aware valuation is not a one-button operation: different balances of pairwise graph priority versus individual soft priority produce substantively different valuations of the same data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 45 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
18 of 45 references.
References · 18
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
- 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 165
- 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 132
- 2019Asymmetric Shapley values: incorporating causal knowledge into model-agnostic explainabilitycited by 114
- 2025Investigating Non-Transitivity in LLM-as-a-Judgecited by 34
- 2025Statistical Impossibility and Possibility of Aligning LLMs with Human Preferences: From Condorcet Paradox to Nash Equilibriumcited by 23
- 2025Regression-adjusted Monte Carlo Estimators for Shapley Values and Probabilistic Valuescited by 19
- 2024One Sample Fits All: Approximating All Probabilistic Values Simultaneously and Efficientlycited by 9
6 more
- 2026PolySHAP: Extending KernelSHAP with Interaction-Informed Polynomial Regressioncited by 7
- 2026An Odd Estimator for Shapley Valuescited by 5
- 2021Belief propagation for permutations, rankings, and partial orderscited by 4
- 2025Rethinking Data Value: Asymmetric Data Shapley for Structure-Aware Valuation in Data Markets and Machine Learning Pipelinescited by 2
- 2026Priority-Aware Shapley Valuecited by 2
- 2026First-Order Efficiency for Probabilistic Value Estimation via A Statistical Viewpointcited by 1
Built on by
Not cited yet.