Towards Efficient Data Valuation Based on the Shapley Value
Not on the map. Why?
Abstract (arXiv)
"How much is my data worth?" is an increasingly common question posed by organizations and individuals alike. An answer to this question could allow, for instance, fairly distributing profits among multiple data contributors and determining prospective compensation when data breaches happen. In this paper, we study the problem of data valuation by utilizing the Shapley value, a popular notion of value which originated in cooperative game theory. The Shapley value defines a unique payoff scheme that satisfies many desiderata for the notion of data value. However, the Shapley value often requires exponential time to compute. To meet this challenge, we propose a repertoire of efficient algorithms for approximating the Shapley value. We also demonstrate the value of each training instance for various benchmark datasets.
Key facts. Cited by 281 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 33; 2023: 50; 2024: 61; 2025: 61; 2026: 44.
281 papers.
Sort:
By area:
- 2021Understanding Dataset Difficulty with V-Usable Informationcited by 291
- 2023TRAK: Attributing Model Behavior at Scalecited by 283
- 2022Datamodels: Predicting Predictions from Training Datacited by 189
- 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 165
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 135
- 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 132
- 2023Foundation Models and Fair Usecited by 116
- 2022The Shapley Value in Machine Learningcited by 98
- 2024What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functionscited by 94
- 2022DataPerf: Benchmarks for Data-Centric AI Developmentcited by 90
- 2024Data Shapley in One Training Runcited by 81
- 2021GTG-Shapley: Efficient and Accurate Participant Contribution Evaluation in Federated Learningcited by 74
38 more
- 2022Faith-Shap: The Faithful Shapley Interaction Indexcited by 69
- 2023LAVA: Data Valuation without Pre-Specified Learning Algorithmscited by 69
- 2021Towards Fairness-Aware Federated Learningcited by 58
- 2023Fair Federated Medical Image Segmentation via Client Contribution Estimationcited by 52
- 2023SHAP-IQ: Unified Approximation of any-order Shapley Interactionscited by 51
- 2022Measuring the Effect of Training Data on Deep Learning Predictions via Randomized Experimentscited by 50
- 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
- 2021Incentive Mechanisms for Federated Learning: From Economic and Game Theoretic Perspectivecited by 47
- 2023Evaluating Data Attribution for Text-to-Image Modelscited by 45
- 2023The Journey, Not the Destination: How Data Guides Diffusion Modelscited by 43
- 2021One for One, or All for All: Equilibria and Optimality of Collaboration in Federated Learningcited by 39
- 2022Mechanisms that Incentivize Data Sharing in Federated Learningcited by 39
- 2021HYDRA: Hypergradient Data Relevance Analysis for Interpreting Deep Neural Networkscited by 38
- 2021A Comprehensive Survey of Incentive Mechanism for Federated Learningcited by 38
- 2023Data-OOB: Out-of-bag Estimate as a Simple and Efficient Data Valuecited by 38
- 2022First is Better Than Last for Language Data Influencecited by 34
- 2024Training Data Attribution via Approximate Unrolled Differentiationcited by 34
- 2022CS-Shapley: Class-wise Shapley Values for Data Valuation in Classificationcited by 32
- 2024Most Influential Subset Selection: Challenges, Promises, and Beyondcited by 32
- 2021DataLens: Scalable Privacy Preserving Training via Gradient Compression and Aggregationcited by 31
- 2024Rethinking Data Shapley for Data Selection Tasks: Misleads and Meritscited by 29
- 2024Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Modelscited by 29
- 2021Data Shapley Valuation for Efficient Batch Active Learningcited by 27
- 2022Repairing Neural Networks by Leaving the Right Past Behindcited by 27
- 2021SHAQ: Incorporating Shapley Value Theory into Multi-Agent Q-Learningcited by 26
- 2021The Shapley Value of Classifiers in Ensemble Gamescited by 23
- 2022Shapley-NAS: Discovering Operation Contribution for Neural Architecture Searchcited by 23
- 2022Understanding Influence Functions and Datamodels via Harmonic Analysiscited by 23
- 2024Provably Accurate Shapley Value Estimation via Leverage Score Samplingcited by 23
- 2021Improving Fairness for Data Valuation in Horizontal Federated Learningcited by 22
- 2024Data Attribution for Text-to-Image Models by Unlearning Synthesized Imagescited by 22
- 2024Permissive Information-Flow Analysis for Large Language Modelscited by 22
- 2024Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Modelscited by 22
- 2023Data Selection for Fine-tuning Large Language Models Using Transferred Shapley Valuescited by 21
- 2024Stochastic Amortization: A Unified Approach to Accelerate Feature and Data Attributioncited by 21
- 2021Incentivizing Collaboration in Machine Learning via Synthetic Data Rewardscited by 20
- 2022Fundamentals of Task-Agnostic Data Valuationcited by 19
- 2023Threshold KNN-Shapley: A Linear-Time and Privacy-Friendly Approach to Data Valuationcited by 19
50 most cited of 281 All 281 (JSON)
- 2026Groups Don't Move as One: A Bregman Clustering View of Linearized Group Influence10 Oct 2026
- 2026Effective Synthetic Data Curation Requires Group-Level Signals30 Sep 2026
- 2026Distilling Diffusion Score Discrepancy for Efficient Training Data Attribution30 Sep 2026
- 2026dattri-LLM: A Unified and Efficient Library for Training Data Attribution at LLM Scale30 Sep 2026
- 2026Data Attribution via Sketched Metadifferentiation14 Sep 2026
- 2026MeClear: Cooperative Game-Theoretic Attribution and Risk-Aware Memory Clearance for Long-Horizon LLM Agents8 Sep 2026
- 2026Vision: Data-Centric Anchoring for Robust and Interpretable Agentic AI8 Sep 2026
- 2026From Detrimental to Beneficial: Dynamic Influence-based Valuation and Editing23 Aug 2026
- 2026SFGA: A Statistics-First Gating Architecture with Adjudicative Escalation for Trustworthy SFT Data Procurement21 Jul 2026
- 2026Nonlinear Axiomatic Attribution for Cooperative Games10 Jul 2026
- 2026Validation-Induced Shapley Shifts: How Validation Structure Distorts Data Valuation4 Jul 2026
- 2026Efficient Decentralized Multi-task Dataset Valuation via Model Merging3 Jul 2026
38 more
- 2026What's a Credit Worth? A Market Framework for Attribution-Aware Compensation in Generative Music1 Jul 2026
- 2026TimeLAVA: Learning-Agnostic Valuation for Time Series Data17 Jun 2026
- 2026MAStrike: Shapley-Guided Collusive Red-Teaming on Multi-Agent Systems11 Jun 2026
- 2026Market Design for AI: Beyond the Copyright Binary10 Jun 2026
- 2026ShaplEIG: Bayesian Experimental Design for Shapley Value Estimation1 Jun 2026
- 2026AlphaToken: Decoupling Adaptation and Stability for Path-Aware Response Token Valuation in LLM Post-Training1 Jun 2026
- 2026De-attribute to Forget for LLM Unlearning29 May 2026
- 2026Fairness-Aware Federated Learning with Trajectory Shapley Value28 May 2026
- 2026CHRONOS: Temporally-Aware Multi-Agent Coordination for Evolving Data Marketplaces22 May 2026
- 2026Choose Wisely and Privately: Proactive Client Selection for Fair and Efficient Federated Learning20 May 2026
- 2026Dynamic Shapley Computation20 May 2026
- 2026Incentivizing Truthfulness and Collaborative Fairness in Bayesian Learning12 May 2026
- 2026Is Data Shapley Not Better than Random in Data Selection? Ask NASH11 May 2026
- 2026Quotient Semivalues for False-Name-Resistant Data Attribution8 May 2026
- 2026In-Context Credit Assignment via the Core7 May 2026
- 2026Knowledge-Free Correlated Agreement for Incentivizing Federated Learning6 May 2026
- 2026Temporal-Decay Shapley: A Time-Aware Data Valuation Framework for Time-Series Data4 May 2026
- 2026SCARV: Structure-Constrained Aggregation for Stable Sample Ranking in Redundant NLP Datasets1 May 2026
- 2026Calibrating Attribution Proxies for Reward Allocation in Participatory Weather Sensing30 Apr 2026
- 2026Utility-Aware Data Pricing: Token-Level Quality and Empirical Training Gain for LLMs24 Apr 2026
- 2026Adalina: Adaptive Linear Approximation for the Shapley Value and Beyond9 Apr 2026
- 2026ShapleyLaw: A Game-Theoretic Approach to Multilingual Scaling Laws18 Mar 2026
- 2026Less Data, Faster Convergence: Goal-Driven Data Optimization for Multimodal Instruction Tuning12 Mar 2026
- 2026Local Shapley: Model-Induced Locality and Optimal Reuse in Data Valuation4 Mar 2026
- 2026TreeGrad-Ranker: Feature Ranking via O(L)-Time Gradients for Decision Trees12 Feb 2026
- 2026Exactly Computing do-Shapley Values6 Feb 2026
- 2026An Odd Estimator for Shapley Values1 Feb 2026
- 2026Imperfect Influence, Preserved Rankings: A Theory of TRAK for Data Attribution1 Feb 2026
- 2026In-Run Data Shapley for Adam Optimizer30 Jan 2026
- 2026Shaping capabilities with token-level data filtering29 Jan 2026
- 2026Top-k on a Budget: Adaptive Ranking with Weak and Strong Oracles28 Jan 2026
- 2026A Sustainable AI Economy Needs Data Deals That Work for Generators15 Jan 2026
- 2025From Points to Coalitions: Hierarchical Contrastive Shapley Values for Prioritizing Data Samples22 Dec 2025
- 2025On the Accuracy of Newton Step and Influence Function Data Attributions14 Dec 2025
- 2025Shapley-based Data Valuation for LLM Alignment via Sequential Preference Optimization12 Dec 2025
- 2025Natural Geometry of Robust Data Attribution: From Convex Models to Deep Networks9 Dec 2025
- 2025Data Value in the Age of Scaling: Understanding LLM Scaling Dynamics Under Real-Synthetic Data Mixtures17 Nov 2025
- 2025Fast Data Attribution for Text-to-Image Models13 Nov 2025
50 newest of 281 All 281 (JSON)
- 2024Data Attribution for Text-to-Image Models by Unlearning Synthesized Imagescited by 22
- 2025Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safetycited by 10
- 2025Where Did It Go Wrong? Attributing Undesirable LLM Behaviors via Representation Gradient Tracingcited by 4
- 2025Losing is for Cherishing: Data Valuation Based on Machine Unlearning and Shapley Valuecited by 1
- 2026De-attribute to Forget for LLM Unlearningcited by 0
- 2026MAStrike: Shapley-Guided Collusive Red-Teaming on Multi-Agent Systemscited by 0
- 2026Data Attribution via Sketched Metadifferentiationcited by 0
- 2026Data Attribution via Sketched Metadifferentiation14 Sep 2026
- 2026MAStrike: Shapley-Guided Collusive Red-Teaming on Multi-Agent Systems11 Jun 2026
- 2026De-attribute to Forget for LLM Unlearning29 May 2026
- 2025Where Did It Go Wrong? Attributing Undesirable LLM Behaviors via Representation Gradient Tracing26 Sep 2025
- 2025Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety5 Jun 2025
- 2025Losing is for Cherishing: Data Valuation Based on Machine Unlearning and Shapley Value22 May 2025
- 2024Data Attribution for Text-to-Image Models by Unlearning Synthesized Images13 Jun 2024
- 2023The Journey, Not the Destination: How Data Guides Diffusion Modelscited by 43
- 2024Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Modelscited by 22
- 2025Fast Data Attribution for Text-to-Image Modelscited by 7
- 2025Concept-TRAK: Understanding how diffusion models learn concepts through concept-level attributioncited by 3
- 2026Distilling Diffusion Score Discrepancy for Efficient Training Data Attributioncited by 0
- 2026Distilling Diffusion Score Discrepancy for Efficient Training Data Attribution30 Sep 2026
- 2025Fast Data Attribution for Text-to-Image Models13 Nov 2025
- 2025Concept-TRAK: Understanding how diffusion models learn concepts through concept-level attribution9 Jul 2025
- 2024Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Models24 Oct 2024
- 2023The Journey, Not the Destination: How Data Guides Diffusion Models11 Dec 2023
- 2025Stochastic Self-Organization in Multi-Agent Systemscited by 9
- 2024Counterfactual Effect Decomposition in Multi-Agent Sequential Decision Makingcited by 4
- 2026Vision: Data-Centric Anchoring for Robust and Interpretable Agentic AIcited by 0
- 2026MeClear: Cooperative Game-Theoretic Attribution and Risk-Aware Memory Clearance for Long-Horizon LLM Agentscited by 0
- 2026MeClear: Cooperative Game-Theoretic Attribution and Risk-Aware Memory Clearance for Long-Horizon LLM Agents8 Sep 2026
- 2026Vision: Data-Centric Anchoring for Robust and Interpretable Agentic AI8 Sep 2026
- 2025Stochastic Self-Organization in Multi-Agent Systems1 Oct 2025
- 2024Counterfactual Effect Decomposition in Multi-Agent Sequential Decision Making16 Oct 2024
- 2025CoKV: Optimizing KV Cache Allocation via Cooperative Game21 Feb 2025
- 2021Understanding Dataset Difficulty with V-Usable Informationcited by 291
- 2023TRAK: Attributing Model Behavior at Scalecited by 283
- 2022Datamodels: Predicting Predictions from Training Datacited by 189
- 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 165
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 135
- 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 132
- 2023Foundation Models and Fair Usecited by 116
- 2022The Shapley Value in Machine Learningcited by 98
- 2024What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functionscited by 94
- 2022DataPerf: Benchmarks for Data-Centric AI Developmentcited by 90
- 2024Data Shapley in One Training Runcited by 81
- 2021GTG-Shapley: Efficient and Accurate Participant Contribution Evaluation in Federated Learningcited by 74
12 most cited of 258 All 258 (JSON)
- 2026Groups Don't Move as One: A Bregman Clustering View of Linearized Group Influence10 Oct 2026
- 2026dattri-LLM: A Unified and Efficient Library for Training Data Attribution at LLM Scale30 Sep 2026
- 2026From Detrimental to Beneficial: Dynamic Influence-based Valuation and Editing23 Aug 2026
- 2026SFGA: A Statistics-First Gating Architecture with Adjudicative Escalation for Trustworthy SFT Data Procurement21 Jul 2026
- 2026Nonlinear Axiomatic Attribution for Cooperative Games10 Jul 2026
- 2026Validation-Induced Shapley Shifts: How Validation Structure Distorts Data Valuation4 Jul 2026
- 2026Efficient Decentralized Multi-task Dataset Valuation via Model Merging3 Jul 2026
- 2026What's a Credit Worth? A Market Framework for Attribution-Aware Compensation in Generative Music1 Jul 2026
- 2026TimeLAVA: Learning-Agnostic Valuation for Time Series Data17 Jun 2026
- 2026Market Design for AI: Beyond the Copyright Binary10 Jun 2026
- 2026ShaplEIG: Bayesian Experimental Design for Shapley Value Estimation1 Jun 2026
- 2026AlphaToken: Decoupling Adaptation and Stability for Path-Aware Response Token Valuation in LLM Post-Training1 Jun 2026
12 newest of 258 All 258 (JSON)