# GTG-Shapley: Efficient and Accurate Participant Contribution Evaluation in Federated Learning

arXiv: https://arxiv.org/abs/2109.02053 · HTML: https://mlsanity.com/paper/2109.02053/

## Key facts

- Cited by 74 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 42 references that are in the map.
- First posted on arXiv 5 Sep 2021.

## Builds on (most cited first, 16 of 16)

- [Communication-Efficient Learning of Deep Networks from Decentralized Data](https://mlsanity.com/paper/1602.05629/) (2016)
- [Data Shapley: Equitable Valuation of Data for Machine Learning](https://mlsanity.com/paper/1904.02868/) (2019)
- [Towards Personalized Federated Learning](https://mlsanity.com/paper/2103.00710/) (2021)
- [Towards Efficient Data Valuation Based on the Shapley Value](https://mlsanity.com/paper/1902.10275/) (2019)
- [A Principled Approach to Data Valuation for Federated Learning](https://mlsanity.com/paper/2009.06192/) (2020)
- [Collaborative Fairness in Federated Learning](https://mlsanity.com/paper/2008.12161/) (2020)
- [Measure Contribution of Participants in Federated Learning](https://mlsanity.com/paper/1909.08525/) (2019)
- [Bounding the Estimation Error of Sampling-based Shapley Value Approximation](https://mlsanity.com/paper/1306.4265/) (2013)
- [FMore: An Incentive Scheme of Multi-dimensional Auction for Federated Learning in MEC](https://mlsanity.com/paper/2002.09699/) (2020)
- [FOCUS: Dealing with Label Quality Disparity in Federated Learning](https://mlsanity.com/paper/2001.11359/) (2020)
- [A Crowdsourcing Framework for On-Device Federated Learning](https://mlsanity.com/paper/1911.01046/) (2019)
- [Hierarchically Fair Federated Learning](https://mlsanity.com/paper/2004.10386/) (2020)
- [Joint Service Pricing and Cooperative Relay Communication for Federated Learning](https://mlsanity.com/paper/1811.12082/) (2018)
- [Estimation of Individual Device Contributions for Incentivizing Federated Learning](https://mlsanity.com/paper/2009.09371/) (2020)
- [Rewarding High-Quality Data via Influence Functions](https://mlsanity.com/paper/1908.11598/) (2019)
- [When Crowdsensing Meets Federated Learning: Privacy-Preserving Mobile Crowdsensing System](https://mlsanity.com/paper/2102.10109/) (2021)

## Built on by (most cited first, 30 of 74)

- [Vertical Federated Learning: Concepts, Advances and Challenges](https://mlsanity.com/paper/2211.12814/) (2022)
- [Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark](https://mlsanity.com/paper/2311.06750/) (2023)
- [The Shapley Value in Machine Learning](https://mlsanity.com/paper/2202.05594/) (2022)
- [Towards Fairness-Aware Federated Learning](https://mlsanity.com/paper/2111.01872/) (2021)
- [FedGH: Heterogeneous Federated Learning with Generalized Global Header](https://mlsanity.com/paper/2303.13137/) (2023)
- [Fair Federated Medical Image Segmentation via Client Contribution Estimation](https://mlsanity.com/paper/2303.16520/) (2023)
- [WeightedSHAP: analyzing and improving Shapley based feature attributions](https://mlsanity.com/paper/2209.13429/) (2022)
- [Advances and Open Challenges in Federated Foundation Models](https://mlsanity.com/paper/2404.15381/) (2024)
- [Fair and efficient contribution valuation for vertical federated learning](https://mlsanity.com/paper/2201.02658/) (2022)
- [Data Valuation and Detections in Federated Learning](https://mlsanity.com/paper/2311.05304/) (2023)
- [Redefining Contributions: Shapley-Driven Federated Learning](https://mlsanity.com/paper/2406.00569/) (2024)
- [Fairness-Aware Client Selection for Federated Learning](https://mlsanity.com/paper/2307.10738/) (2023)
- [FedImpro: Measuring and Improving Client Update in Federated Learning](https://mlsanity.com/paper/2402.07011/) (2024)
- [Towards Verifiable Federated Learning](https://mlsanity.com/paper/2202.08310/) (2022)
- [Towards Interpretable Federated Learning](https://mlsanity.com/paper/2302.13473/) (2023)
- [Stochastic Self-Organization in Multi-Agent Systems](https://mlsanity.com/paper/2510.00685/) (2025)
- [Differentially Private Shapley Values for Data Evaluation](https://mlsanity.com/paper/2206.00511/) (2022)
- [Greedy Shapley Client Selection for Communication-Efficient Federated Learning](https://mlsanity.com/paper/2312.09108/) (2023)
- [Statistical Significance of Feature Importance Rankings](https://mlsanity.com/paper/2401.15800/) (2024)
- [Reward Systems for Trustworthy Medical Federated Learning](https://mlsanity.com/paper/2205.00470/) (2022)
- [Towards More Efficient Data Valuation in Healthcare Federated Learning using Ensembling](https://mlsanity.com/paper/2209.05424/) (2022)
- [Aequa: Fair Model Rewards in Collaborative Learning via Slimmable Networks](https://mlsanity.com/paper/2502.04850/) (2025)
- [Auction-Based Ex-Post-Payment Incentive Mechanism Design for Horizontal Federated Learning with Reputation and Contribution Measurement](https://mlsanity.com/paper/2201.02410/) (2022)
- [Proof-of-Contribution-Based Design for Collaborative Machine Learning on Blockchain](https://mlsanity.com/paper/2302.14031/) (2023)
- [A Survey on Contribution Evaluation in Vertical Federated Learning](https://mlsanity.com/paper/2405.02364/) (2024)
- [ACE: A Model Poisoning Attack on Contribution Evaluation Methods in Federated Learning](https://mlsanity.com/paper/2405.20975/) (2024)
- [Trustworthy Federated Learning: A Survey](https://mlsanity.com/paper/2305.11537/) (2023)
- [Intelligent Agents for Auction-based Federated Learning: A Survey](https://mlsanity.com/paper/2404.13244/) (2024)
- [Exploring Data Redundancy in Real-world Image Classification through Data Selection](https://mlsanity.com/paper/2306.14113/) (2023)
- [Multi-Session Budget Optimization for Forward Auction-based Federated Learning](https://mlsanity.com/paper/2311.12548/) (2023)

## Abstract (arXiv)

Federated Learning (FL) bridges the gap between collaborative machine learning and preserving data privacy. To sustain the long-term operation of an FL ecosystem, it is important to attract high quality data owners with appropriate incentive schemes. As an important building block of such incentive schemes, it is essential to fairly evaluate participants' contribution to the performance of the final FL model without exposing their private data. Shapley Value (SV)-based techniques have been widely adopted to provide fair evaluation of FL participant contributions. However, existing approaches incur significant computation costs, making them difficult to apply in practice. In this paper, we propose the Guided Truncation Gradient Shapley (GTG-Shapley) approach to address this challenge. It reconstructs FL models from gradient updates for SV calculation instead of repeatedly training with different combinations of FL participants. In addition, we design a guided Monte Carlo sampling approach combined with within-round and between-round truncation to further reduce the number of model reconstructions and evaluations required, through extensive experiments under diverse realistic data distribution settings. The results demonstrate that GTG-Shapley can closely approximate actual Shapley values, while significantly increasing computational efficiency compared to the state of the art, especially under non-i.i.d. settings.
