mlsanityData to 14 Oct 2026

Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradients

arXiv 2504.05822 ↗First posted 8 Apr 2025cs.LGcited by 1

On the map: LLM safety and security → Federated unlearning and poisoning

Abstract (arXiv)

The right to be forgotten is a fundamental principle of privacy-preserving regulations and extends to Machine Learning (ML) paradigms such as Federated Learning (FL). While FL enhances privacy by enabling collaborative model training without sharing private data, trained models still retain the influence of training data. Federated Unlearning (FU) methods recently proposed often rely on impractical assumptions for real-world FL deployments, such as storing client update histories or requiring access to a publicly available dataset. To address these constraints, this paper introduces a novel method that leverages negated Pseudo-gradients Updates for Federated Unlearning (PUF). Our approach only uses standard client model updates, which are employed during regular FL rounds, and interprets them as pseudo-gradients. When a client needs to be forgotten, we apply the negation of their pseudo-gradients, appropriately scaled, to the global model. Unlike state-of-the-art mechanisms, PUF seamlessly integrates with FL workflows, incurs no additional computational and communication overhead beyond standard FL rounds, and supports concurrent unlearning requests. We extensively evaluated the proposed method on two well-known benchmark image classification datasets (CIFAR-10 and CIFAR-100) and a real-world medical imaging dataset for segmentation (ProstateMRI), using three different neural architectures: two residual networks and a vision transformer. The experimental results across various settings demonstrate that PUF achieves state-of-the-art forgetting effectiveness and recovery time, without relying on any additional assumptions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Federated unlearning and poisoning, one of 12 directions in LLM safety and security. Builds on 31 of its 59 references that are in the map. First posted on arXiv 8 Apr 2025.

Builds on

31 of 59 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025NoT: Federated Unlearning via Weight Negation7 Mar
  2. 2024Unlearning during Learning: An Efficient Federated Machine Unlearning Method24 May
  3. 2024Ferrari: Federated Feature Unlearning via Optimizing Feature Sensitivity23 May
  4. 2024Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metrics10 Jan
  5. 2023A Survey on Federated Unlearning: Challenges, Methods, and Future Directions31 Oct
  6. 2022Federated Unlearning: How to Efficiently Erase a Client in FL?12 Jul
  7. 2022The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retraining14 Mar
  8. 2022Federated Unlearning with Knowledge Distillation24 Jan
  9. 2021Federated Unlearning via Class-Discriminative Pruning22 Oct

Other references · 22

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  4. 2019Advances and Open Problems in Federated Learningcited by 3,046
  5. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  6. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  7. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  8. 2020Adaptive Federated Optimizationcited by 1,046
  9. 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
  10. 2019Towards Federated Learning at Scale: System Designcited by 832
  11. 2020Systematic Evaluation of Privacy Risks of Machine Learning Modelscited by 292
  12. 2023Model Sparsity Can Simplify Machine Unlearningcited by 214
10 more
  1. 2022Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks using an Incompetent Teachercited by 194
  2. 2020MS-Net: Multi-Site Network for Improving Prostate Segmentation with Heterogeneous MRI Datacited by 121
  3. 2021Personalized Federated Learning through Local Memorizationcited by 57
  4. 2023Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomycited by 51
  5. 2024Threats, Attacks, and Defenses in Machine Unlearning: A Surveycited by 39
  6. 2022Multi-Level Branched Regularization for Federated Learningcited by 34
  7. 2022Knowledge Distillation for Federated Learning: a Practical Guidecited by 31
  8. 2022Membership Inference via Backdooringcited by 27
  9. 2023FedFA: Federated Feature Augmentationcited by 22
  10. 2020Effectiveness of Arbitrary Transfer Sets for Data-free Knowledge Distillationcited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023Exploring Federated Unlearning: Review, Comparison, and Insights
  2. 2024Streamlined Federated Unlearning: Unite as One to Be Highly Efficient
  3. 2026PrivEraserVerify: Efficient, Private, and Verifiable Federated Unlearning
  4. 2025Tackling Federated Unlearning as a Parameter Estimation Problem
  5. 2024Efficient Federated Unlearning with Adaptive Differential Privacy Preservation
  6. 2025Federated Unlearning in the Wild: Rethinking Fairness and Data Discrepancy
  7. 2024Communication Efficient and Provable Federated Unlearning
  8. 2024Federated Unlearning with Gradient Descent and Conflict Mitigation