mlsanityData to 7 Oct 2026

Is Data Valuation Learnable and Interpretable?

arXiv 2406.02612 ↗First posted 3 Jun 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Measuring the value of individual samples is critical for many data-driven tasks, e.g., the training of a deep learning model. Recent literature witnesses the substantial efforts in developing data valuation methods. The primary data valuation methodology is based on the Shapley value from game theory, and various methods are proposed along this path. {Even though Shapley value-based valuation has solid theoretical basis, it is entirely an experiment-based approach and no valuation model has been constructed so far.} In addition, current data valuation methods ignore the interpretability of the output values, despite an interptable data valuation method is of great helpful for applications such as data pricing. This study aims to answer an important question: is data valuation learnable and interpretable? A learned valuation model have several desirable merits such as fixed number of parameters and knowledge reusability. An intrepretable data valuation model can explain why a sample is valuable or invaluable. To this end, two new data value modeling frameworks are proposed, in which a multi-layer perception~(MLP) and a new regression tree are utilized as specific base models for model training and interpretability, respectively. Extensive experiments are conducted on benchmark datasets. {The experimental results provide a positive answer for the question.} Our study opens up a new technical path for the assessing of data values. Large data valuation models can be built across many different data-driven tasks, which can promote the widespread application of data valuation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 3 Jun 2024.

Builds on

23 of 37 references.

References · 23

  1. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  2. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  3. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
  4. 2019The many Shapley values for model explanationcited by 341
  5. 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 279
  6. 2017Distilling a Neural Network Into a Soft Decision Treecited by 230
  7. 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 162
  8. 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 147
  9. 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 126
  10. 2019Data Valuation using Reinforcement Learningcited by 115
  11. 2022Algorithms to estimate Shapley value feature attributionscited by 114
  12. 2018Deep Neural Decision Treescited by 72
11 more
  1. 2023LAVA: Data Valuation without Pre-Specified Learning Algorithmscited by 69
  2. 2023A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learningcited by 66
  3. 2023OpenDataVal: a Unified Benchmark for Data Valuationcited by 55
  4. 2022Measuring the Effect of Training Data on Deep Learning Predictions via Randomized Experimentscited by 50
  5. 2020NBDT: Neural-Backed Decision Treescited by 46
  6. 2020A Survey on Data Pricing: from Economics to Data Sciencecited by 39
  7. 2023Data-OOB: Out-of-bag Estimate as a Simple and Efficient Data Valuecited by 38
  8. 2016Self-Paced Learning: an Implicit Regularization Perspectivecited by 21
  9. 2023HarsanyiNet: Computing Accurate Shapley Values in a Single Forward Propagationcited by 16
  10. 2023Data Optimization in Deep Learning: A Surveycited by 6
  11. 2021Sparse Kronecker-Product Coding for Unsourced Multiple Accesscited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.