EASE: Federated Multimodal Unlearning via Entanglement-Aware Anchor Closure
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Federated Multimodal Learning (FML) trains multimodal models across decentralized clients while keeping their image-text pairs private. However, joint embedding training entangles forgotten knowledge across both modalities and client gradient subspaces, hindering federated unlearning. Previous federated unlearning approaches neither sever the cross-modal reconstruction channel mediated by bilinear coupling nor separate forget-exclusive update directions from those shared with retained clients. We identify an Anchor Principle for federated multimodal contrastive unlearning: forgotten alignments persist through three residual anchors arising from bilinear cross-modal coupling, principal-angle subspace entanglement, and continued federated updates. At the modality level, we show that bilateral displacement of both visual and language branches closes the cross-modal reconstruction channel. Correspondingly, our method addresses subspace entanglement through Cosine--Sine decomposition of client-update subspaces, isolating forget-exclusive directions from retain support. Moreover, we propose a direction-selective Forget Lock that bounds residual drift across rounds. Combining these strategies, we present EASE, an Entanglement-Aware Subspace Excision framework that closes all three anchor channels under a unified design. EASE demonstrates consistent superiority across multiple datasets and unlearning scenarios, for instance, matching the retrain reference to within 0.2 and 4.2 R@1 points on the forget and retain sides under client unlearning on Flickr30K with CLIP-B/32.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 37 of its 58 references that are in the map. First posted on arXiv 1 May 2026.
Builds on
37 of 58 references.
Closest ancestors · 3
Same direction, newest first
- 2025Cross-Modal Unlearning via Influential Neuron Path Editing in Multimodal Large Language Models10 Nov
- 2024SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning28 Apr
- 2021On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning22 Oct
Other references · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
- 2019Machine Unlearningcited by 1,020
22 more
- 2014Deep Visual-Semantic Alignments for Generating Image Descriptionscited by 966
- 2021Membership Inference Attacks From First Principlescited by 839
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
- 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 398
- 2019Orthogonal Gradient Descent for Continual Learningcited by 361
- 2021Gradient Projection Memory for Continual Learningcited by 338
- 2021Training Networks in Null Space of Feature Covariance for Continual Learningcited by 139
- 2021Federated Unlearning via Class-Discriminative Pruningcited by 108
- 2022Federated Unlearning: How to Efficiently Erase a Client in FL?cited by 90
- 2023Multimodal Federated Learning via Contrastive Representation Ensemblecited by 85
- 2022Federated Unlearning with Knowledge Distillationcited by 70
- 2023FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learningcited by 59
- 2022FedRecover: Recovering from Poisoning Attacks in Federated Learning using Historical Informationcited by 53
- 2022VeriFi: Towards Verifiable Federated Unlearningcited by 41
- 2024Federated Unlearning with Gradient Descent and Conflict Mitigationcited by 15
- 2025Unlearning through Knowledge Overwriting: Reversible Federated Unlearning via Selective Sparse Adaptercited by 15
- 2025NoT: Federated Unlearning via Weight Negationcited by 15
- 2024Ferrari: Federated Feature Unlearning via Optimizing Feature Sensitivitycited by 11
- 2025Enhancing Vehicular Platooning with Wireless Federated Learning: A Resource-Aware Control Frameworkcited by 9
- 2025"X of Information'' Continuum: A Survey on AI-Driven Multi-dimensional Metrics for Next-Generation Networked Systemscited by 7
- 2026RELIEF: Turning Missing Modalities into Training Acceleration for Federated Learning on Heterogeneous IoT Edgecited by 7
- 2026Lifecycle-Aware Federated Continual Learning in Mobile Autonomous Systemscited by 7
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Forget to Improve: On-Device LLM-Agent Continual Learning via Budget-Curated Memorycited by 8
- 2026CrystalMem: Elastic Memory for Self-Evolving LLM Agents via Knowledge Crystallizationcited by 2
- 2026ERRAND: Budgeted Maintenance of Agent Memorycited by 1
- 2026When Unlearning Fails: Reliable Data Deletion under Post-Training in Agent Networkscited by 0
- 2026Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agentscited by 0
- 2026Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents1 Oct 2026
- 2026ERRAND: Budgeted Maintenance of Agent Memory2 Sep 2026
- 2026CrystalMem: Elastic Memory for Self-Evolving LLM Agents via Knowledge Crystallization31 Jul 2026
- 2026When Unlearning Fails: Reliable Data Deletion under Post-Training in Agent Networks30 Jul 2026
- 2026Forget to Improve: On-Device LLM-Agent Continual Learning via Budget-Curated Memory23 Jun 2026