mlsanityData to 14 Oct 2026

On the Impact of the Utility in Semivalue-based Data Valuation

arXiv 2502.06574 ↗First posted 10 Feb 2025cs.AI cs.GT cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Semivalue-based data valuation uses cooperative-game theory intuitions to assign each data point a value reflecting its contribution to a downstream task. Still, those values depend on the practitioner's choice of utility, raising the question: How robust is semivalue-based data valuation to changes in the utility? This issue is critical when the utility is set as a trade-off between several criteria and when practitioners must select among multiple equally valid utilities. We address this by introducing the notion of a dataset's spatial signature: given a semivalue, we embed each data point into a lower-dimensional space in which any utility becomes a linear functional, making the data valuation framework amenable to a simpler geometric picture. Building on this, we propose a practical methodology centered on an explicit robustness metric that informs practitioners whether and by how much their data valuation results will shift as the utility changes. We validate this approach across diverse datasets and semivalues, demonstrating strong agreement with rank-correlation analyses and offering analytical insight into how choosing a semivalue can amplify or diminish robustness.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 47 references that are in the map. First posted on arXiv 10 Feb 2025.

Builds on

17 of 47 references.

References · 17

  1. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  2. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  3. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  4. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
  5. 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 395
  6. 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 281
  7. 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 165
  8. 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 148
  9. 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 132
  10. 2020A Distributional Framework for Data Valuationcited by 80
  11. 2023OpenDataVal: a Unified Benchmark for Data Valuationcited by 55
  12. 2020Efficient computation and analysis of distributional Shapley valuescited by 38
5 more
  1. 2020Data Valuation for Medical Imaging Using Shapley Value: Application on A Large-scale Chest X-ray Datasetcited by 34
  2. 2024Rethinking Data Shapley for Data Selection Tasks: Misleads and Meritscited by 29
  3. 2018Revisiting the Gelman-Rubin Diagnosticcited by 18
  4. 2024Efficient Data Shapley for Weighted Nearest Neighbor Algorithmscited by 18
  5. 2023DU-Shapley: A Shapley Value Proxy for Efficient Dataset Valuationcited by 12

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.