SIFU: Sequential Informed Federated Unlearning for Efficient and Provable Client Unlearning in Federated Optimization
On the map: LLM safety and security → Federated unlearning and poisoning
Abstract (arXiv)
Machine Unlearning (MU) is an increasingly important topic in machine learning safety, aiming at removing the contribution of a given data point from a training procedure. Federated Unlearning (FU) consists in extending MU to unlearn a given client's contribution from a federated training routine. While several FU methods have been proposed, we currently lack a general approach providing formal unlearning guarantees to the FedAvg routine, while ensuring scalability and generalization beyond the convex assumption on the clients' loss functions. We aim at filling this gap by proposing SIFU (Sequential Informed Federated Unlearning), a new FU method applying to both convex and non-convex optimization regimes. SIFU naturally applies to FedAvg without additional computational cost for the clients and provides formal guarantees on the quality of the unlearning task. We provide a theoretical analysis of the unlearning properties of SIFU, and practically demonstrate its effectiveness as compared to a panel of unlearning methods from the state-of-the-art.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in Federated unlearning and poisoning, one of 12 directions in LLM safety and security. Builds on 25 of its 46 references that are in the map. First posted on arXiv 21 Nov 2022.
Builds on
25 of 46 references.
Closest ancestors · 5
Same direction, newest first
- 2022Machine Unlearning of Federated Clusters28 Oct
- 2022Federated Unlearning: How to Efficiently Erase a Client in FL?12 Jul
- 2022The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retraining14 Mar
- 2021Forget-SVGD: Particle-Based Bayesian Federated Unlearning23 Nov
- 2021Federated Unlearning via Class-Discriminative Pruning22 Oct
Other references · 20
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
- 2019Machine Unlearningcited by 1,020
- 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 897
- 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 836
- 2018LEAF: A Benchmark for Federated Settingscited by 780
- 2015Train faster, generalize better: Stability of stochastic gradient descentcited by 547
- 2019Certified Data Removal from Machine Learning Modelscited by 512
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 447
- 2020Descent-to-Delete: Gradient-Based Methods for Machine Unlearningcited by 303
8 more
- 2020Approximate Data Deletion from Machine Learning Modelscited by 250
- 2020Forgetting Outside the Box: Scrubbing Deep Networks of Information Accessible from Input-Output Observationscited by 171
- 2021Adaptive Machine Unlearningcited by 164
- 2020Mixed-Privacy Forgetting in Deep Networkscited by 158
- 2020Understanding Gradient Clipping in Private SGD: A Geometric Perspectivecited by 140
- 2020Towards Probabilistic Verification of Machine Unlearningcited by 46
- 2021Certifiable Machine Unlearning for Linear Modelscited by 42
- 2020Online Forgetting Process for Linear Regression Modelscited by 21
Built on by
Citing papers per year: 2024: 7; 2025: 5; 2026: 4.
16 papers.
Sort:
By area:
- 2024Machine Unlearning: A Comprehensive Surveycited by 33
- 2025Ten Challenging Problems in Federated Foundation Modelscited by 20
- 2024Rewind-to-Delete: Certified Machine Unlearning for Nonconvex Functionscited by 17
- 2025When to Forget? Complexity Trade-offs in Machine Unlearningcited by 9
- 2024Towards Efficient and Certified Recovery from Poisoning Attacks in Federated Learningcited by 7
- 2024ConDa: Fast Federated Unlearning with Contribution Dampeningcited by 2
- 2025Addressing Out-of-Label Hazard Detection in Dashcam Videos: Insights from the COOOL Challengecited by 2
- 2026Certified Unlearning in Decentralized Federated Learningcited by 2
- 2025BadFU: Backdoor Federated Learning through Adversarial Machine Unlearningcited by 1
- 2024A Survey on Federated Unlearning: Challenges and Opportunitiescited by 0
- 2024Beyond Right to be Forgotten: Managing Heterogeneity Side Effects Through Strategic Incentivescited by 0
- 2024Federated Unlearning Model Recovery in Data with Skewed Label Distributionscited by 0
4 more
- 2025Descend or Rewind? Stochastic Gradient Descent Unlearningcited by 0
- 2026Variance-Reduced (varepsilon,δ)-Unlearning using Forget Set Gradientscited by 0
- 2026pFedUL: Layer-Aware Federated Unlearning for Personalized Federated Learningcited by 0
- 2026When Unlearning Fails: Reliable Data Deletion under Post-Training in Agent Networkscited by 0
- 2026When Unlearning Fails: Reliable Data Deletion under Post-Training in Agent Networks30 Jul 2026
- 2026pFedUL: Layer-Aware Federated Unlearning for Personalized Federated Learning15 Jun 2026
- 2026Variance-Reduced (varepsilon,δ)-Unlearning using Forget Set Gradients16 Feb 2026
- 2026Certified Unlearning in Decentralized Federated Learning10 Jan 2026
- 2025Descend or Rewind? Stochastic Gradient Descent Unlearning20 Nov 2025
- 2025BadFU: Backdoor Federated Learning through Adversarial Machine Unlearning21 Aug 2025
- 2025When to Forget? Complexity Trade-offs in Machine Unlearning24 Feb 2025
- 2025Ten Challenging Problems in Federated Foundation Models14 Feb 2025
- 2025Addressing Out-of-Label Hazard Detection in Dashcam Videos: Insights from the COOOL Challenge27 Jan 2025
- 2024Federated Unlearning Model Recovery in Data with Skewed Label Distributions18 Dec 2024
- 2024Beyond Right to be Forgotten: Managing Heterogeneity Side Effects Through Strategic Incentives19 Oct 2024
- 2024ConDa: Fast Federated Unlearning with Contribution Dampening5 Oct 2024
4 more
- 2024Rewind-to-Delete: Certified Machine Unlearning for Nonconvex Functions15 Sep 2024
- 2024Machine Unlearning: A Comprehensive Survey13 May 2024
- 2024A Survey on Federated Unlearning: Challenges and Opportunities4 Mar 2024
- 2024Towards Efficient and Certified Recovery from Poisoning Attacks in Federated Learning16 Jan 2024
- 2024Machine Unlearning: A Comprehensive Surveycited by 33
- 2025Ten Challenging Problems in Federated Foundation Modelscited by 20
- 2024Rewind-to-Delete: Certified Machine Unlearning for Nonconvex Functionscited by 17
- 2025When to Forget? Complexity Trade-offs in Machine Unlearningcited by 9
- 2024ConDa: Fast Federated Unlearning with Contribution Dampeningcited by 2
- 2026Certified Unlearning in Decentralized Federated Learningcited by 2
- 2024A Survey on Federated Unlearning: Challenges and Opportunitiescited by 0
- 2024Beyond Right to be Forgotten: Managing Heterogeneity Side Effects Through Strategic Incentivescited by 0
- 2025Descend or Rewind? Stochastic Gradient Descent Unlearningcited by 0
- 2026Variance-Reduced (varepsilon,δ)-Unlearning using Forget Set Gradientscited by 0
- 2026pFedUL: Layer-Aware Federated Unlearning for Personalized Federated Learningcited by 0
- 2026When Unlearning Fails: Reliable Data Deletion under Post-Training in Agent Networkscited by 0
- 2026When Unlearning Fails: Reliable Data Deletion under Post-Training in Agent Networks30 Jul 2026
- 2026pFedUL: Layer-Aware Federated Unlearning for Personalized Federated Learning15 Jun 2026
- 2026Variance-Reduced (varepsilon,δ)-Unlearning using Forget Set Gradients16 Feb 2026
- 2026Certified Unlearning in Decentralized Federated Learning10 Jan 2026
- 2025Descend or Rewind? Stochastic Gradient Descent Unlearning20 Nov 2025
- 2025When to Forget? Complexity Trade-offs in Machine Unlearning24 Feb 2025
- 2025Ten Challenging Problems in Federated Foundation Models14 Feb 2025
- 2024Beyond Right to be Forgotten: Managing Heterogeneity Side Effects Through Strategic Incentives19 Oct 2024
- 2024ConDa: Fast Federated Unlearning with Contribution Dampening5 Oct 2024
- 2024Rewind-to-Delete: Certified Machine Unlearning for Nonconvex Functions15 Sep 2024
- 2024Machine Unlearning: A Comprehensive Survey13 May 2024
- 2024A Survey on Federated Unlearning: Challenges and Opportunities4 Mar 2024
- 2024Towards Efficient and Certified Recovery from Poisoning Attacks in Federated Learningcited by 7
- 2025Addressing Out-of-Label Hazard Detection in Dashcam Videos: Insights from the COOOL Challengecited by 2
- 2025BadFU: Backdoor Federated Learning through Adversarial Machine Unlearningcited by 1
- 2024Federated Unlearning Model Recovery in Data with Skewed Label Distributionscited by 0
- 2025BadFU: Backdoor Federated Learning through Adversarial Machine Unlearning21 Aug 2025
- 2025Addressing Out-of-Label Hazard Detection in Dashcam Videos: Insights from the COOOL Challenge27 Jan 2025
- 2024Federated Unlearning Model Recovery in Data with Skewed Label Distributions18 Dec 2024
- 2024Towards Efficient and Certified Recovery from Poisoning Attacks in Federated Learning16 Jan 2024