Client-Side Probing of Deleted Ridge Statistics in Federated Unlearning
On the map: LLM safety and security → Federated unlearning and poisoning
Abstract (arXiv)
Federated unlearning aims to remove a client's data from a shared model without retraining from scratch. Some efficient systems make deletion exact by storing compact, additive summaries of the training features and broadcasting an updated linear classifier after every accepted change. We show that these broadcasts can also reveal the hidden summaries. A malicious client can submit known changes, use the returned classifiers to identify the server state, and compare states immediately before and after an isolated deletion. This exposes the deleted sample, class, or client summary and can enable its reinsertion. We characterize exactly when the observations contain enough independent information, give a matching optimal construction for unrestricted probes, and derive a more realistic estimator based on additions formed from the attacker's own data. On MNIST and CIFAR-10, high-precision broadcasts permit exact label recovery for every tested sample deletion with both probe types. Lower-precision broadcasts sharply reduce fine-grained recovery, and insufficiently diverse responses prevent identification altogether. Unrestricted probes are readily detected by their size; most individual attacker-data additions resemble honest batches, although we do not claim that the complete sequence is inconspicuous. The results identify a concrete privacy and integrity risk, its algebraic cause, and practical limits involving broadcast precision, update verification, response rate, and concurrent activity.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Federated unlearning and poisoning, one of 12 directions in LLM safety and security. Builds on 11 of its 16 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
11 of 16 references.
Closest ancestors · 3
Same direction, newest first
- 2026Exact Federated Continual Unlearning for Ridge Heads on Frozen Foundation Models13 Mar
- 2025Model Inversion Attack against Federated Unlearning20 Feb
- 2022The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retraining14 Mar
Other references · 8
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
- 2024Learn What You Want to Unlearn: Unlearning Inversion Attacks against Machine Unlearningcited by 43
- 2024Reconstruction Attacks on Machine Unlearning: Simple Models are Vulnerablecited by 24
- 2022Deletion Inference, Reconstruction, and Compliance in Machine (Un)Learningcited by 19
- 2024Unlearn and Burn: Adversarial Machine Unlearning Requests Destroy Model Accuracycited by 15
- 2026Protecting the Undeleted in Machine Unlearningcited by 1
Built on by
Not cited yet.