Towards Reasoning-Preserving Unlearning in Multimodal Large Language Models
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 2 more
Abstract (arXiv)
Machine unlearning aims to erase requested data from trained models without full retraining. For Reasoning Multimodal Large Language Models (RMLLMs), this is uniquely challenging: intermediate chain-of-thought steps can still leak sensitive information even when final answers are forgotten, and overly aggressive interventions easily damage general reasoning ability. Yet no benchmark jointly evaluates how well unlearning methods suppress reasoning-level leakage while preserving reasoning competence. We address this gap with RMLLMU-Bench, the first benchmark for RMLLM unlearning that extends standard forgetting metrics with dedicated measures of reasoning leakage and reasoning retention. A systematic evaluation on RMLLMU-Bench reveals that existing unlearning methods for MLLMs and Large (Language) Reasoning Models (LRMs) either leave substantial leakage in the reasoning process or severely degrade reasoning performance. To address these gaps, we propose R-MUSE (Reasoning-preserving MLLM Unlearning via Subspace guidance and Adaptive Steering), a training-free and inference-time intervention framework that steers internal representations to forget both answers and reasoning traces while explicitly preserving general reasoning. Experiments on RMLLMU-Bench demonstrate that R-MUSE achieves a substantially better balance between effective forgetting and reasoning retention.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 40 of its 84 references that are in the map. First posted on arXiv 26 Nov 2025.
Builds on
40 of 84 references.
Closest ancestors · 2
Same direction, newest first
- 2025Automating Steering for Safe Multimodal Large Language Models17 Jul
- 2025Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skills15 Jun
Other references · 38
- 2023Visual Instruction Tuningcited by 7,869
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 504
- 2023Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Modelscited by 184
- 2023Recent Advances in Optimal Transport for Machine Learningcited by 66
- 2024Reducing Hallucinations in Vision-Language Models via Latent Space Steeringcited by 59
- 2024Locate-then-edit for Multi-hop Factual Recall under Knowledge Editingcited by 37
- 2025Evaluating and Steering Modality Preferences in Multimodal Large Language Modelcited by 33
- 2025MMUnlearner: Reformulating Multimodal Machine Unlearning in the Era of Multimodal Large Language Modelscited by 30
- 2024Dissecting Fine-Tuning Unlearning in Large Language Modelscited by 26
26 more
- 2025Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Modelscited by 26
- 2024Exploring the Personality Traits of LLMs through Latent Features Steeringcited by 22
- 2025Model-agnostic Adversarial Attack and Defense for Vision-Language-Action Modelscited by 22
- 2025Flattery in Motion: Benchmarking and Analyzing Sycophancy in Video-LLMscited by 21
- 2025When Modalities Conflict: How Unimodal Reasoning Uncertainty Governs Preference Dynamics in MLLMscited by 21
- 2024CLIPErase: Efficient Unlearning of Visual-Textual Associations in CLIPcited by 19
- 2025HiPhO: How Far Are (M)LLMs from Humans in the Latest High School Physics Olympiad Benchmark?cited by 19
- 2024Communication Efficient and Provable Federated Unlearningcited by 18
- 2025Model Unlearning via Sparse Autoencoder Subspace Guided Projectionscited by 18
- 2025Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objectscited by 17
- 2025Adaptive Multi-Subspace Representation Steering for Attribute Alignment in Large Language Modelscited by 16
- 2024A Hopfieldian View-based Interpretation for Chain-of-Thought Reasoningcited by 15
- 2025Learning to Steer: Input-dependent Steering for Multimodal LLMscited by 15
- 2025Towards User-level Private Reinforcement Learning with Human Feedbackcited by 14
- 2025Scaling Physical Reasoning with the PHYSICS Datasetcited by 13
- 2025Understanding and Mitigating Cross-lingual Privacy Leakage via Language-specific and Universal Privacy Neuronscited by 13
- 2025MONICA: Real-Time Monitoring and Calibration of Chain-of-Thought Sycophancy in Large Reasoning Modelscited by 12
- 2025Towards Lifecycle Unlearning Commitment Management: Measuring Sample-level Unlearning Completenesscited by 11
- 2025PIXEL: Adaptive Steering Via Position-wise Injection with eXact Estimated Levels under Subspace Calibrationcited by 11
- 2024Dissecting Representation Misalignment in Contrastive Learning via Influence Functioncited by 8
- 2025Scrub It Out! Erasing Sensitive Memorization in Code Language Models via Machine Unlearningcited by 7
- 2025PhysicsMinions: Winning Gold Medals in the Latest Physics Olympiads with a Coevolutionary Multimodal Multi-Agent Systemcited by 7
- 2025SCI-Verifier: Scientific Verifier with Thinkingcited by 6
- 2024Robust SVD Made Easy: A fast and reliable algorithm for large-scale data analysiscited by 4
- 2025Reasoning Vectors: Transferring Chain-of-Thought Capabilities via Task Arithmeticcited by 4
- 2025Tracing and Mitigating Hallucinations in Multimodal LLMs via Dynamic Attention Localizationcited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Controlling Repetition in Protein Language Modelscited by 5
- 2026Bayesian Gated Non-Negative Contrastive Learningcited by 0
- 2026Multi-Adapter Representation Interventions via Energy Calibrationcited by 0
- 2026CUSE: Fine-Grained Multimodal Unlearning with Counterfactual Guidance and On-Policy Self-Distillationcited by 0
- 2026CUSE: Fine-Grained Multimodal Unlearning with Counterfactual Guidance and On-Policy Self-Distillation10 Oct 2026
- 2026Multi-Adapter Representation Interventions via Energy Calibration27 May 2026
- 2026Bayesian Gated Non-Negative Contrastive Learning27 May 2026
- 2026Controlling Repetition in Protein Language Models31 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026REDaCT: Collapse-Free Unlearning in Large Reasoning Models
- 2026Exploring and Bridging Knowledge Holes in Unlearned Multimodal Large Language Models
- 2026Making LLMs Truly Forget: Deep Unlearning by Searching, Selecting, and Severing Knowledge Paths
- 2026Selective Forgetting for Large Reasoning Models
- 2025BLUR: A Benchmark for LLM Unlearning Robust to Forget-Retain Overlap
- 2026GUARD: Natural Forgetting in Large Reasoning Models via Guided Answer-Reasoning Distillation
- 2025SafeEraser: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning
- 2025Unlearning That Lasts: Utility-Preserving, Robust, and Almost Irreversible Forgetting in LLMs