mlsanityData to 7 Oct 2026

Efficient Federated Unlearning with Adaptive Differential Privacy Preservation

arXiv 2411.11044 ↗First posted 17 Nov 2024cs.CR cs.LGcited by 2

On the map: LLM safety and security → Federated unlearning and poisoning

Abstract (arXiv)

Federated unlearning (FU) offers a promising solution to effectively address the need to erase the impact of specific clients' data on the global model in federated learning (FL), thereby granting individuals the ``Right to be Forgotten". The most straightforward approach to achieve unlearning is to train the model from scratch, excluding clients who request data removal, but it is resource-intensive. Current state-of-the-art FU methods extend traditional FL frameworks by leveraging stored historical updates, enabling more efficient unlearning than training from scratch. However, the use of stored updates introduces significant privacy risks. Adversaries with access to these updates can potentially reconstruct clients' local data, a well-known vulnerability in the privacy domain. While privacy-enhanced techniques exist, their applications to FU scenarios that balance unlearning efficiency with privacy protection remain underexplored. To address this gap, we propose FedADP, a method designed to achieve both efficiency and privacy preservation in FU. Our approach incorporates an adaptive differential privacy (DP) mechanism, carefully balancing privacy and unlearning performance through a novel budget allocation strategy tailored for FU. FedADP also employs a dual-layered selection process, focusing on global models with significant changes and client updates closely aligned with the global model, reducing storage and communication costs. Additionally, a novel calibration method is introduced to facilitate effective unlearning. Extensive experimental results demonstrate that FedADP effectively manages the trade-off between unlearning efficiency and privacy protection.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Federated unlearning and poisoning, one of 12 directions in LLM safety and security. Builds on 17 of its 34 references that are in the map. First posted on arXiv 17 Nov 2024.

Builds on

17 of 34 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023A Survey on Federated Unlearning: Challenges, Methods, and Future Directions31 Oct
  2. 2023Subspace based Federated Unlearning24 Feb

Other references · 15

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  2. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  3. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  4. 2019Machine Unlearningcited by 1,020
  5. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
  6. 2018How To Backdoor Federated Learningcited by 745
  7. 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 698
  8. 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 528
  9. 2019Hidden Trigger Backdoor Attackscited by 359
  10. 2020FLTrust: Byzantine-robust Federated Learning via Trust Bootstrappingcited by 330
  11. 2018Generalized Byzantine-tolerant SGDcited by 94
  12. 2021Differentially Private Federated Learning on Heterogeneous Datacited by 74
3 more
  1. 2022FedRecover: Recovering from Poisoning Attacks in Federated Learning using Historical Informationcited by 53
  2. 2022Efficient Dropout-resilient Aggregation for Privacy-preserving Machine Learningcited by 18
  3. 2024Towards Efficient and Certified Recovery from Poisoning Attacks in Federated Learningcited by 7

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.