Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
With the growing adoption of VLMs, DMs, LLMs, and AFMs, these multimodal foundation models can inadvertently encode sensitive, copyrighted, biased, or unsafe cross-modal associations that originate from their training data. Retraining after deletion requests or policy updates is often impractical, and targeted forgetting remains difficult because knowledge is distributed across shared representations. Multimodal unlearning addresses this challenge by enabling selective removal across modalities while retaining overall utility. This survey offers a unified, system-oriented view of multimodal unlearning across vision, language, audio, and video, grounded in recent advances, emerging applications, and open problems. Our taxonomy enables systematic comparison across model architectures and modalities, clarifying trade-offs among deletion strength, retention, efficiency, reversibility, and robustness. This survey highlights open problems and practical considerations to support future research and deployment of multimodal unlearning. We release a curated repository: https://smsnobin77.github.io/Awesome-Multimodal-Unlearning/
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 120 of its 183 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
120 of 183 references.
Closest ancestors · 28
Same direction, newest first
- 2025No Encore: Unlearning as Opt-Out in Music Generation8 Sep
- 2025Quantum-Inspired Audio Unlearning: Towards Privacy-Preserving Voice Biometrics29 Jul
- 2025Do Not Mimic My Voice: Speaker Identity Unlearning for Zero-Shot Text-to-Speech27 Jul
- 2025Unlearning the Noisy Correspondence Makes CLIP More Robust4 Jul
- 2025PULSE: Practical Evaluation Scenarios for Large Multimodal Model Unlearning2 Jul
- 2025SUA: Stealthy Multimodal Large Language Model Unlearning Attack10 Jun
- 2025"Alexa, can you forget me?" Machine Unlearning Benchmark in Spoken Language Understanding21 May
- 2025Unlearning Sensitive Information in Multimodal LLMs: Benchmark and Attack-Defense Evaluation1 May
- 2025Human Motion Unlearning24 Mar
- 2025A Comprehensive Survey of Machine Unlearning Techniques for Large Language Models22 Feb
- 2025SafeEraser: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning18 Feb
- 2025SEMU: Singular Value Decomposition for Efficient Machine Unlearning11 Feb
16 more
- 2024Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Dataset5 Nov
- 2024CLIPErase: Efficient Unlearning of Visual-Textual Associations in CLIP30 Oct
- 2024Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench29 Oct
- 2024CLEAR: Character Unlearning in Textual and Visual Modalities23 Oct
- 2024Enhancing User-Centric Privacy Protection: An Interactive Framework through Diffusion Models and Machine Unlearning5 Sep
- 2024Machine Unlearning in Generative AI: A Survey30 Jul
- 2024Targeted Unlearning with Single Layer Unlearning Gradient16 Jul
- 2024On Large Language Model Continual Unlearning14 Jul
- 2024Zero-Shot Class Unlearning in CLIP with Synthetic Samples10 Jul
- 2024MU-Bench: A Multitask Multimodal Benchmark for Machine Unlearning21 Jun
- 2024Large Language Model Unlearning via Embedding-Corrupted Prompts12 Jun
- 2024MUC: Machine Unlearning for Contrastive Learning with Black-box Evaluation5 Jun
- 2024Digital Forgetting in Large Language Models: A Survey of Unlearning Methods2 Apr
- 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
- 2023Model Sparsity Can Simplify Machine Unlearning11 Apr
- 2021Remember What You Want to Forget: Algorithms for Machine Unlearning4 Mar
Other references · 92
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
- 2015VQA: Visual Question Answeringcited by 2,489
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
38 more
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
- 2018Demystifying MMD GANscited by 1,268
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
- 2019Machine Unlearningcited by 1,020
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
- 2018VizWiz Grand Challenge: Answering Visual Questions from Blind Peoplecited by 852
- 2021Membership Inference Attacks From First Principlescited by 839
- 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 741
- 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
- 2019Certified Data Removal from Machine Learning Modelscited by 512
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 501
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 457
- 2014Learning Face Representation from Scratchcited by 451
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 447
- 2023Unified Concept Editing in Diffusion Modelscited by 377
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 368
- 2020Descent-to-Delete: Gradient-Based Methods for Machine Unlearningcited by 303
- 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 298
- 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 264
- 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
- 2023SneakyPrompt: Jailbreaking Text-to-image Generative Modelscited by 175
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2024SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generationcited by 125
- 2022Measuring the Carbon Intensity of AI in Cloud Instancescited by 110
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 81
- 2025SAeUron: Interpretable Concept Unlearning in Diffusion Models with Sparse Autoencoderscited by 75
- 2018AudioMNIST: Exploring Explainable Artificial Intelligence for Audio Analysis on a Simple Benchmarkcited by 72
- 2024Unlearning Concepts in Diffusion Model via Concept Domain Correction and Concept Preserving Gradientcited by 69
- 2023CleanCLIP: Mitigating Data Poisoning Attacks in Multimodal Contrastive Learningcited by 62
- 2024VLSBench: Unveiling Visual Leakage in Multimodal Safetycited by 59
- 2024Machine Unlearning for Image-to-Image Generative Modelscited by 47
- 2018Contemplating Visual Emotions: Understanding and Overcoming Dataset Biascited by 41
- 2024Meta-Unlearning on Diffusion Models: Preventing Relearning Unlearned Conceptscited by 39
- 2024Precise, Fast, and Low-cost Concept Erasure in Value Space: Orthogonal Complement Matterscited by 38
- 2022Unlearnable Clusters: Towards Label-agnostic Unlearnable Examplescited by 35
- 2024CLIP the Bias: How Useful is Balancing Data in Multimodal Learning?cited by 35
50 most cited of 92 All 92 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026OracleZoom: On-Policy Self-Distillation Inspired Reference-Constrained Recursive Image Super Resolutioncited by 1
- 2026BEFORE THE FLIP: Measuring Hidden Score Shifts In Quantized Vision Language Models Before The Answer Changes for Visual Question Answeringcited by 1
- 2026Toward Fine-Grained Forgetting:Attribute Unlearning for Multimodal Large Language Modelscited by 0
- 2026New Evidence, Same Choice: Testing Physical Experiment Selection in Vision Language Modelscited by 0
- 2026Inference-Time Target Speaker Unlearning in LLM-Based Automatic Speech Recognitioncited by 0
- 2026RASteer: Retain-Aware Activation Steering for Concept Erasure in Diffusion Modelscited by 0
- 2026RASteer: Retain-Aware Activation Steering for Concept Erasure in Diffusion Models1 Oct 2026
- 2026Inference-Time Target Speaker Unlearning in LLM-Based Automatic Speech Recognition24 Sep 2026
- 2026New Evidence, Same Choice: Testing Physical Experiment Selection in Vision Language Models10 Sep 2026
- 2026BEFORE THE FLIP: Measuring Hidden Score Shifts In Quantized Vision Language Models Before The Answer Changes for Visual Question Answering7 Sep 2026
- 2026OracleZoom: On-Policy Self-Distillation Inspired Reference-Constrained Recursive Image Super Resolution6 Sep 2026
- 2026Toward Fine-Grained Forgetting:Attribute Unlearning for Multimodal Large Language Models2 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Stochastic Meta-Unlearning: Bridging Language Backbone and Multimodal Unlearning
- 2026On the Robustness of Machine Unlearning for Vision-Language Models
- 2026One Modality to Forget Them All: Enhancing Cross-Modal Unlearning in Vision-Language Models
- 2026PPU-Bench:Real World Benchmark for Personalized Partial Unlearning in Vision Language Models
- 2025PEBench: A Fictitious Dataset to Benchmark Machine Unlearning for Multimodal Large Language Models
- 2026Visual-Noise Guided In-Context Distillation for Multimodal Large Language Model Unlearning
- 2025MLLMEraser: Achieving Test-Time Unlearning in Multimodal Large Language Models through Activation Steering
- 2024Single Image Unlearning: Efficient Machine Unlearning in Multimodal Large Language Models