mlsanityData to 7 Oct 2026

Federated Unlearning in the Wild: Rethinking Fairness and Data Discrepancy

arXiv 2510.07022 ↗First posted 8 Oct 2025cs.LG cs.AIcited by 0

On the map: LLM safety and security → Federated unlearning and poisoning

Abstract (arXiv)

Machine unlearning is critical for enforcing data deletion rights like the "right to be forgotten." As a decentralized paradigm, Federated Learning (FL) also requires unlearning, but realistic implementations face two major challenges. First, fairness in Federated Unlearning (FU) is often overlooked. Exact unlearning methods typically force all clients into costly retraining, even those uninvolved. Approximate approaches, using gradient ascent or distillation, make coarse interventions that can unfairly degrade performance for clients with only retained data. Second, most FU evaluations rely on synthetic data assumptions (IID/non-IID) that ignore real-world heterogeneity. These unrealistic benchmarks obscure the true impact of unlearning and limit the applicability of current methods. We first conduct a comprehensive benchmark of existing FU methods under realistic data heterogeneity and fairness conditions. We then propose a novel, fairness-aware FU approach, Federated Cross-Client-Constrains Unlearning (FedCCCU), to explicitly address both challenges. FedCCCU offers a practical and scalable solution for real-world FU. Experimental results show that existing methods perform poorly in realistic settings, while our approach consistently outperforms them.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Federated unlearning and poisoning, one of 12 directions in LLM safety and security. Builds on 13 of its 30 references that are in the map. First posted on arXiv 8 Oct 2025.

Builds on

13 of 30 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Ferrari: Federated Feature Unlearning via Optimizing Feature Sensitivity23 May
  2. 2024Scalable Federated Unlearning via Isolated and Coded Sharding29 Jan
  3. 2023Heterogeneous Federated Knowledge Graph Embedding Learning and Unlearning4 Feb
  4. 2022Federated Unlearning: How to Efficiently Erase a Client in FL?12 Jul
  5. 2022The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retraining14 Mar

Other references · 8

  1. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  2. 2019Machine Unlearningcited by 1,020
  3. 2018LEAF: A Benchmark for Federated Settingscited by 780
  4. 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
  5. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 424
  6. 2020Learning from History for Byzantine Robust Optimizationcited by 137
  7. 2022FedRecover: Recovering from Poisoning Attacks in Federated Learning using Historical Informationcited by 53
  8. 2021DeepObliviate: A Powerful Charm for Erasing Data Residual Memory in Deep Neural Networkscited by 19

Built on by

Not cited yet.