Losing is for Cherishing: Data Valuation Based on Machine Unlearning and Shapley Value
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
The proliferation of large models has intensified the need for efficient data valuation methods to quantify the contribution of individual data providers. Traditional approaches, such as game-theory-based Shapley value and influence-function-based techniques, face prohibitive computational costs or require access to full data and model training details, making them hardly achieve partial data valuation. To address this, we propose Unlearning Shapley, a novel framework that leverages machine unlearning to estimate data values efficiently. By unlearning target data from a pretrained model and measuring performance shifts on a reachable test set, our method computes Shapley values via Monte Carlo sampling, avoiding retraining and eliminating dependence on full data. Crucially, Unlearning Shapley supports both full and partial data valuation, making it scalable for large models (e.g., LLMs) and practical for data markets. Experiments on benchmark datasets and large-scale text corpora demonstrate that our approach matches the accuracy of state-of-the-art methods while reducing computational overhead by orders of magnitude. Further analysis confirms a strong correlation between estimated values and the true impact of data subsets, validating its reliability in real-world scenarios. This work bridges the gap between data valuation theory and practical deployment, offering a scalable, privacy-compliant solution for modern AI ecosystems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 28 of its 37 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
28 of 37 references.
Closest ancestors · 7
Same direction, newest first
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Models8 Jul
- 2024Are we making progress in unlearning? Findings from the first NeurIPS unlearning competition13 Jun
- 2024Machine Unlearning: A Comprehensive Survey13 May
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
- 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
- 2023Large Language Model Unlearning14 Oct
- 2023Towards Unbounded Machine Unlearning20 Feb
Other references · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2016Pointer Sentinel Mixture Modelscited by 2,992
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2019Machine Unlearningcited by 1,020
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 565
- 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 492
- 2019Nuanced Metrics for Measuring Unintended Bias with Real Data for Text Classificationcited by 396
- 2023Studying Large Language Model Generalization with Influence Functionscited by 311
- 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 279
9 more
- 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 162
- 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 147
- 2019Data Valuation using Reinforcement Learningcited by 115
- 2022Federated Unlearning: How to Efficiently Erase a Client in FL?cited by 90
- 2024What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functionscited by 88
- 2023OpenDataVal: a Unified Benchmark for Data Valuationcited by 55
- 2022CS-Shapley: Class-wise Shapley Values for Data Valuation in Classificationcited by 32
- 2023Data Valuation and Detections in Federated Learningcited by 17
- 2025FW-Shapley: Real-time Estimation of Weighted Shapley Valuescited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025SoK: Machine Unlearning for Large Language Modelscited by 9
- 2025SoK: Machine Unlearning for Large Language Models10 Jun 2025