GTG-Shapley: Efficient and Accurate Participant Contribution Evaluation in Federated Learning
Not on the map. Why?
Abstract (arXiv)
Federated Learning (FL) bridges the gap between collaborative machine learning and preserving data privacy. To sustain the long-term operation of an FL ecosystem, it is important to attract high quality data owners with appropriate incentive schemes. As an important building block of such incentive schemes, it is essential to fairly evaluate participants' contribution to the performance of the final FL model without exposing their private data. Shapley Value (SV)-based techniques have been widely adopted to provide fair evaluation of FL participant contributions. However, existing approaches incur significant computation costs, making them difficult to apply in practice. In this paper, we propose the Guided Truncation Gradient Shapley (GTG-Shapley) approach to address this challenge. It reconstructs FL models from gradient updates for SV calculation instead of repeatedly training with different combinations of FL participants. In addition, we design a guided Monte Carlo sampling approach combined with within-round and between-round truncation to further reduce the number of model reconstructions and evaluations required, through extensive experiments under diverse realistic data distribution settings. The results demonstrate that GTG-Shapley can closely approximate actual Shapley values, while significantly increasing computational efficiency compared to the state of the art, especially under non-i.i.d. settings.
Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). Builds on 16 of its 42 references that are in the map. First posted on arXiv 5 Sep 2021.
Builds on
16 of 42 references.
References · 16
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
- 2021Towards Personalized Federated Learningcited by 462
- 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 279
- 2020A Principled Approach to Data Valuation for Federated Learningcited by 127
- 2020Collaborative Fairness in Federated Learningcited by 95
- 2019Measure Contribution of Participants in Federated Learningcited by 78
- 2013Bounding the Estimation Error of Sampling-based Shapley Value Approximationcited by 56
- 2020FMore: An Incentive Scheme of Multi-dimensional Auction for Federated Learning in MECcited by 48
- 2020FOCUS: Dealing with Label Quality Disparity in Federated Learningcited by 36
- 2019A Crowdsourcing Framework for On-Device Federated Learningcited by 32
- 2020Hierarchically Fair Federated Learningcited by 28
4 more
- 2018Joint Service Pricing and Cooperative Relay Communication for Federated Learningcited by 22
- 2020Estimation of Individual Device Contributions for Incentivizing Federated Learningcited by 14
- 2019Rewarding High-Quality Data via Influence Functionscited by 11
- 2021When Crowdsensing Meets Federated Learning: Privacy-Preserving Mobile Crowdsensing Systemcited by 7
Built on by
Citing papers per year: 2021: 1; 2022: 9; 2023: 17; 2024: 22; 2025: 15; 2026: 9.
73 papers.
Sort:
By area:
- 2022Vertical Federated Learning: Concepts, Advances and Challengescited by 104
- 2022The Shapley Value in Machine Learningcited by 97
- 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmarkcited by 97
- 2021Towards Fairness-Aware Federated Learningcited by 57
- 2023FedGH: Heterogeneous Federated Learning with Generalized Global Headercited by 56
- 2023Fair Federated Medical Image Segmentation via Client Contribution Estimationcited by 50
- 2022WeightedSHAP: analyzing and improving Shapley based feature attributionscited by 36
- 2024Advances and Open Challenges in Federated Foundation Modelscited by 33
- 2022Fair and efficient contribution valuation for vertical federated learningcited by 18
- 2023Data Valuation and Detections in Federated Learningcited by 17
- 2024Redefining Contributions: Shapley-Driven Federated Learningcited by 16
- 2023Fairness-Aware Client Selection for Federated Learningcited by 15
38 more
- 2024FedImpro: Measuring and Improving Client Update in Federated Learningcited by 15
- 2022Towards Verifiable Federated Learningcited by 11
- 2023Towards Interpretable Federated Learningcited by 11
- 2025Stochastic Self-Organization in Multi-Agent Systemscited by 9
- 2022Differentially Private Shapley Values for Data Evaluationcited by 8
- 2024Statistical Significance of Feature Importance Rankingscited by 7
- 2022Reward Systems for Trustworthy Medical Federated Learningcited by 6
- 2022Towards More Efficient Data Valuation in Healthcare Federated Learning using Ensemblingcited by 6
- 2023Greedy Shapley Client Selection for Communication-Efficient Federated Learningcited by 6
- 2025Aequa: Fair Model Rewards in Collaborative Learning via Slimmable Networkscited by 6
- 2022Auction-Based Ex-Post-Payment Incentive Mechanism Design for Horizontal Federated Learning with Reputation and Contribution Measurementcited by 5
- 2023Proof-of-Contribution-Based Design for Collaborative Machine Learning on Blockchaincited by 5
- 2024A Survey on Contribution Evaluation in Vertical Federated Learningcited by 5
- 2024ACE: A Model Poisoning Attack on Contribution Evaluation Methods in Federated Learningcited by 5
- 2023Trustworthy Federated Learning: A Surveycited by 4
- 2024Intelligent Agents for Auction-based Federated Learning: A Surveycited by 4
- 2023Exploring Data Redundancy in Real-world Image Classification through Data Selectioncited by 3
- 2023Multi-Session Budget Optimization for Forward Auction-based Federated Learningcited by 3
- 2024Contribution Evaluation of Heterogeneous Participants in Federated Learning via Prototypical Representationscited by 3
- 2024Benchmarking Data Heterogeneity Evaluation Approaches for Personalized Federated Learningcited by 3
- 2023Incentive Allocation in Vertical Federated Learning Based on Bankruptcy Problemcited by 2
- 2024Towards Fair, Robust and Efficient Client Contribution Evaluation in Federated Learningcited by 2
- 2024On the Volatility of Shapley-Based Contribution Metrics in Federated Learningcited by 2
- 2024Maverick-Aware Shapley Valuation for Client Selection in Federated Learningcited by 2
- 2024A Comprehensive Study of Shapley Value in Data Analyticscited by 2
- 2025Efficient Data Valuation Approximation in Federated Learning: A Sampling-based Approachcited by 2
- 2025Faithful Group Shapley Valuecited by 2
- 2025Analyzing the Impact of Participant Failures in Cross-Silo Federated Learningcited by 2
- 2023Welfare and Fairness Dynamics in Federated Learning: A Client Selection Perspectivecited by 1
- 2023Cross-Silo Federated Learning Across Divergent Domains with Iterative Parameter Alignmentcited by 1
- 2024Emulating Full Participation: An Effective and Fair Client Selection Strategy for Federated Learningcited by 1
- 2024WeShap: Weak Supervision Source Evaluation with Shapley Valuescited by 1
- 2024Federated Learning for Data Market: Shapley-UCB for Seller Selection and Incentivescited by 1
- 2024ROSS: RObust decentralized Stochastic learning based on Shapley valuescited by 1
- 2025VFL-RPS: Relevant Participant Selection in Vertical Federated Learningcited by 1
- 2025The Impact Analysis of Delays in Asynchronous Federated Learning with Data Heterogeneity for Edge Intelligencecited by 1
- 2025On the Fragility of Contribution Score Computation in Federated Learningcited by 1
- 2026Private and Robust Contribution Evaluation in Federated Learningcited by 1
50 most cited of 73 All 73 (JSON)
- 2026Shapley Value Estimation for Multi-Site Data with Blockwise-Missing Features14 Sep 2026
- 2026Fairness-Aware Federated Learning with Trajectory Shapley Value28 May 2026
- 2026Dynamic Shapley Computation20 May 2026
- 2026Knowledge-Free Correlated Agreement for Incentivizing Federated Learning6 May 2026
- 2026Meritocratic Fairness via K-Shapley Values in Budgeted Combinatorial Bandits with Full-Bandit Feedback1 May 2026
- 2026Beyond performance-wise Contribution Evaluation in Federated Learning25 Feb 2026
- 2026Private and Robust Contribution Evaluation in Federated Learning25 Feb 2026
- 2026ANML: Attribution-Native Machine Learning with Guaranteed Robustness12 Feb 2026
- 2026Federated Inference: Toward Privacy-Preserving Collaborative and Incentivized Model Serving9 Feb 2026
- 2025Cost-TrustFL: Cost-Aware Hierarchical Federated Learning with Lightweight Reputation Evaluation across Multi-Cloud23 Dec 2025
- 2025Analyzing the Impact of Participant Failures in Cross-Silo Federated Learning18 Nov 2025
- 2025Stochastic Self-Organization in Multi-Agent Systems1 Oct 2025
38 more
- 2025Lightweight and Robust Federated Data Valuation29 Sep 2025
- 2025On the Fragility of Contribution Score Computation in Federated Learning24 Sep 2025
- 2025Gaming and Cooperation in Federated Learning: What Can Happen and How to Monitor It2 Sep 2025
- 2025Owen Sampling Accelerates Contribution Estimation in Federated Learning28 Aug 2025
- 2025A case for data valuation transparency via DValCards29 Jun 2025
- 2025How to Evaluate Participant Contributions in Decentralized Federated Learning29 May 2025
- 2025Addressing Data Quality Decompensation in Federated Learning via Dynamic Client Selection27 May 2025
- 2025Faithful Group Shapley Value25 May 2025
- 2025Efficient Data Valuation Approximation in Federated Learning: A Sampling-based Approach23 Apr 2025
- 2025The Impact Analysis of Delays in Asynchronous Federated Learning with Data Heterogeneity for Edge Intelligence6 Mar 2025
- 2025VFL-RPS: Relevant Participant Selection in Vertical Federated Learning20 Feb 2025
- 2025Aequa: Fair Model Rewards in Collaborative Learning via Slimmable Networks7 Feb 2025
- 2024A Comprehensive Study of Shapley Value in Data Analytics2 Dec 2024
- 2024Nonlinear Equilibrium Transitions in a Potential Game Model for Federated Learning18 Nov 2024
- 2024ROSS: RObust decentralized Stochastic learning based on Shapley values1 Nov 2024
- 2024DPVS-Shapley:Faster and Universal Contribution Evaluation Component in Federated Learning19 Oct 2024
- 2024Federated Learning for Data Market: Shapley-UCB for Seller Selection and Incentives10 Oct 2024
- 2024Benchmarking Data Heterogeneity Evaluation Approaches for Personalized Federated Learning9 Oct 2024
- 2024Random Gradient Masking as a Defensive Measure to Deep Leakage in Federated Learning15 Aug 2024
- 2024Contribution Evaluation of Heterogeneous Participants in Federated Learning via Prototypical Representations2 Jul 2024
- 2024WeShap: Weak Supervision Source Evaluation with Shapley Values16 Jun 2024
- 2024Redefining Contributions: Shapley-Driven Federated Learning1 Jun 2024
- 2024ACE: A Model Poisoning Attack on Contribution Evaluation Methods in Federated Learning31 May 2024
- 2024Emulating Full Participation: An Effective and Fair Client Selection Strategy for Federated Learning22 May 2024
- 2024Maverick-Aware Shapley Valuation for Client Selection in Federated Learning21 May 2024
- 2024On the Volatility of Shapley-Based Contribution Metrics in Federated Learning13 May 2024
- 2024A Survey on Contribution Evaluation in Vertical Federated Learning3 May 2024
- 2024Advances and Open Challenges in Federated Foundation Models23 Apr 2024
- 2024Intelligent Agents for Auction-based Federated Learning: A Survey20 Apr 2024
- 2024History-Aware and Dynamic Client Contribution in Federated Learning11 Mar 2024
- 2024A Bargaining-based Approach for Feature Trading in Vertical Federated Learning23 Feb 2024
- 2024FedImpro: Measuring and Improving Client Update in Federated Learning10 Feb 2024
- 2024Towards Fair, Robust and Efficient Client Contribution Evaluation in Federated Learning6 Feb 2024
- 2024Statistical Significance of Feature Importance Rankings28 Jan 2024
- 2023Greedy Shapley Client Selection for Communication-Efficient Federated Learning14 Dec 2023
- 2023Multi-Session Budget Optimization for Forward Auction-based Federated Learning21 Nov 2023
- 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark12 Nov 2023
- 2023Data Valuation and Detections in Federated Learning9 Nov 2023
50 newest of 73 All 73 (JSON)
- 2025Stochastic Self-Organization in Multi-Agent Systemscited by 9
- 2025Stochastic Self-Organization in Multi-Agent Systems1 Oct 2025
- 2022Vertical Federated Learning: Concepts, Advances and Challengescited by 104
- 2022The Shapley Value in Machine Learningcited by 97
- 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmarkcited by 97
- 2021Towards Fairness-Aware Federated Learningcited by 57
- 2023FedGH: Heterogeneous Federated Learning with Generalized Global Headercited by 56
- 2023Fair Federated Medical Image Segmentation via Client Contribution Estimationcited by 50
- 2022WeightedSHAP: analyzing and improving Shapley based feature attributionscited by 36
- 2024Advances and Open Challenges in Federated Foundation Modelscited by 33
- 2022Fair and efficient contribution valuation for vertical federated learningcited by 18
- 2023Data Valuation and Detections in Federated Learningcited by 17
- 2024Redefining Contributions: Shapley-Driven Federated Learningcited by 16
- 2023Fairness-Aware Client Selection for Federated Learningcited by 15
12 most cited of 72 All 72 (JSON)
- 2026Shapley Value Estimation for Multi-Site Data with Blockwise-Missing Features14 Sep 2026
- 2026Fairness-Aware Federated Learning with Trajectory Shapley Value28 May 2026
- 2026Dynamic Shapley Computation20 May 2026
- 2026Knowledge-Free Correlated Agreement for Incentivizing Federated Learning6 May 2026
- 2026Meritocratic Fairness via K-Shapley Values in Budgeted Combinatorial Bandits with Full-Bandit Feedback1 May 2026
- 2026Beyond performance-wise Contribution Evaluation in Federated Learning25 Feb 2026
- 2026Private and Robust Contribution Evaluation in Federated Learning25 Feb 2026
- 2026ANML: Attribution-Native Machine Learning with Guaranteed Robustness12 Feb 2026
- 2026Federated Inference: Toward Privacy-Preserving Collaborative and Incentivized Model Serving9 Feb 2026
- 2025Cost-TrustFL: Cost-Aware Hierarchical Federated Learning with Lightweight Reputation Evaluation across Multi-Cloud23 Dec 2025
- 2025Analyzing the Impact of Participant Failures in Cross-Silo Federated Learning18 Nov 2025
- 2025Lightweight and Robust Federated Data Valuation29 Sep 2025
12 newest of 72 All 72 (JSON)