mlsanityData to 7 Oct 2026

EASE: Federated Multimodal Unlearning via Entanglement-Aware Anchor Closure

arXiv 2605.00733 ↗First posted 1 May 2026cs.NI cs.AI cs.LGcited by 5

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Federated Multimodal Learning (FML) trains multimodal models across decentralized clients while keeping their image-text pairs private. However, joint embedding training entangles forgotten knowledge across both modalities and client gradient subspaces, hindering federated unlearning. Previous federated unlearning approaches neither sever the cross-modal reconstruction channel mediated by bilinear coupling nor separate forget-exclusive update directions from those shared with retained clients. We identify an Anchor Principle for federated multimodal contrastive unlearning: forgotten alignments persist through three residual anchors arising from bilinear cross-modal coupling, principal-angle subspace entanglement, and continued federated updates. At the modality level, we show that bilateral displacement of both visual and language branches closes the cross-modal reconstruction channel. Correspondingly, our method addresses subspace entanglement through Cosine--Sine decomposition of client-update subspaces, isolating forget-exclusive directions from retain support. Moreover, we propose a direction-selective Forget Lock that bounds residual drift across rounds. Combining these strategies, we present EASE, an Entanglement-Aware Subspace Excision framework that closes all three anchor channels under a unified design. EASE demonstrates consistent superiority across multiple datasets and unlearning scenarios, for instance, matching the retrain reference to within 0.2 and 4.2 R@1 points on the forget and retain sides under client unlearning on Flickr30K with CLIP-B/32.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 37 of its 58 references that are in the map. First posted on arXiv 1 May 2026.

Builds on

37 of 58 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Cross-Modal Unlearning via Influential Neuron Path Editing in Multimodal Large Language Models10 Nov
  2. 2024SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning28 Apr
  3. 2021On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning22 Oct

Other references · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  5. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  6. 2019Advances and Open Problems in Federated Learningcited by 3,021
  7. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  8. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  9. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
  10. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
  11. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
  12. 2019Machine Unlearningcited by 1,020
22 more
  1. 2014Deep Visual-Semantic Alignments for Generating Image Descriptionscited by 966
  2. 2021Membership Inference Attacks From First Principlescited by 839
  3. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
  4. 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 398
  5. 2019Orthogonal Gradient Descent for Continual Learningcited by 361
  6. 2021Gradient Projection Memory for Continual Learningcited by 338
  7. 2021Training Networks in Null Space of Feature Covariance for Continual Learningcited by 139
  8. 2021Federated Unlearning via Class-Discriminative Pruningcited by 108
  9. 2022Federated Unlearning: How to Efficiently Erase a Client in FL?cited by 90
  10. 2023Multimodal Federated Learning via Contrastive Representation Ensemblecited by 85
  11. 2022Federated Unlearning with Knowledge Distillationcited by 70
  12. 2023FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learningcited by 59
  13. 2022FedRecover: Recovering from Poisoning Attacks in Federated Learning using Historical Informationcited by 53
  14. 2022VeriFi: Towards Verifiable Federated Unlearningcited by 41
  15. 2024Federated Unlearning with Gradient Descent and Conflict Mitigationcited by 15
  16. 2025Unlearning through Knowledge Overwriting: Reversible Federated Unlearning via Selective Sparse Adaptercited by 15
  17. 2025NoT: Federated Unlearning via Weight Negationcited by 15
  18. 2024Ferrari: Federated Feature Unlearning via Optimizing Feature Sensitivitycited by 11
  19. 2025Enhancing Vehicular Platooning with Wireless Federated Learning: A Resource-Aware Control Frameworkcited by 9
  20. 2025"X of Information'' Continuum: A Survey on AI-Driven Multi-dimensional Metrics for Next-Generation Networked Systemscited by 7
  21. 2026RELIEF: Turning Missing Modalities into Training Acceleration for Federated Learning on Heterogeneous IoT Edgecited by 7
  22. 2026Lifecycle-Aware Federated Continual Learning in Mobile Autonomous Systemscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.