mlsanityData to 14 Oct 2026

Towards Reasoning-Preserving Unlearning in Multimodal Large Language Models

arXiv 2512.17911 ↗First posted 26 Nov 2025cs.CL cs.AI cs.LGcited by 4

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 2 more
Abstract (arXiv)

Machine unlearning aims to erase requested data from trained models without full retraining. For Reasoning Multimodal Large Language Models (RMLLMs), this is uniquely challenging: intermediate chain-of-thought steps can still leak sensitive information even when final answers are forgotten, and overly aggressive interventions easily damage general reasoning ability. Yet no benchmark jointly evaluates how well unlearning methods suppress reasoning-level leakage while preserving reasoning competence. We address this gap with RMLLMU-Bench, the first benchmark for RMLLM unlearning that extends standard forgetting metrics with dedicated measures of reasoning leakage and reasoning retention. A systematic evaluation on RMLLMU-Bench reveals that existing unlearning methods for MLLMs and Large (Language) Reasoning Models (LRMs) either leave substantial leakage in the reasoning process or severely degrade reasoning performance. To address these gaps, we propose R-MUSE (Reasoning-preserving MLLM Unlearning via Subspace guidance and Adaptive Steering), a training-free and inference-time intervention framework that steers internal representations to forget both answers and reasoning traces while explicitly preserving general reasoning. Experiments on RMLLMU-Bench demonstrate that R-MUSE achieves a substantially better balance between effective forgetting and reasoning retention.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 40 of its 84 references that are in the map. First posted on arXiv 26 Nov 2025.

Builds on

40 of 84 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Automating Steering for Safe Multimodal Large Language Models17 Jul
  2. 2025Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skills15 Jun

Other references · 38

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  5. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 504
  6. 2023Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Modelscited by 184
  7. 2023Recent Advances in Optimal Transport for Machine Learningcited by 66
  8. 2024Reducing Hallucinations in Vision-Language Models via Latent Space Steeringcited by 59
  9. 2024Locate-then-edit for Multi-hop Factual Recall under Knowledge Editingcited by 37
  10. 2025Evaluating and Steering Modality Preferences in Multimodal Large Language Modelcited by 33
  11. 2025MMUnlearner: Reformulating Multimodal Machine Unlearning in the Era of Multimodal Large Language Modelscited by 30
  12. 2024Dissecting Fine-Tuning Unlearning in Large Language Modelscited by 26
26 more
  1. 2025Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Modelscited by 26
  2. 2024Exploring the Personality Traits of LLMs through Latent Features Steeringcited by 22
  3. 2025Model-agnostic Adversarial Attack and Defense for Vision-Language-Action Modelscited by 22
  4. 2025Flattery in Motion: Benchmarking and Analyzing Sycophancy in Video-LLMscited by 21
  5. 2025When Modalities Conflict: How Unimodal Reasoning Uncertainty Governs Preference Dynamics in MLLMscited by 21
  6. 2024CLIPErase: Efficient Unlearning of Visual-Textual Associations in CLIPcited by 19
  7. 2025HiPhO: How Far Are (M)LLMs from Humans in the Latest High School Physics Olympiad Benchmark?cited by 19
  8. 2024Communication Efficient and Provable Federated Unlearningcited by 18
  9. 2025Model Unlearning via Sparse Autoencoder Subspace Guided Projectionscited by 18
  10. 2025Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objectscited by 17
  11. 2025Adaptive Multi-Subspace Representation Steering for Attribute Alignment in Large Language Modelscited by 16
  12. 2024A Hopfieldian View-based Interpretation for Chain-of-Thought Reasoningcited by 15
  13. 2025Learning to Steer: Input-dependent Steering for Multimodal LLMscited by 15
  14. 2025Towards User-level Private Reinforcement Learning with Human Feedbackcited by 14
  15. 2025Scaling Physical Reasoning with the PHYSICS Datasetcited by 13
  16. 2025Understanding and Mitigating Cross-lingual Privacy Leakage via Language-specific and Universal Privacy Neuronscited by 13
  17. 2025MONICA: Real-Time Monitoring and Calibration of Chain-of-Thought Sycophancy in Large Reasoning Modelscited by 12
  18. 2025Towards Lifecycle Unlearning Commitment Management: Measuring Sample-level Unlearning Completenesscited by 11
  19. 2025PIXEL: Adaptive Steering Via Position-wise Injection with eXact Estimated Levels under Subspace Calibrationcited by 11
  20. 2024Dissecting Representation Misalignment in Contrastive Learning via Influence Functioncited by 8
  21. 2025Scrub It Out! Erasing Sensitive Memorization in Code Language Models via Machine Unlearningcited by 7
  22. 2025PhysicsMinions: Winning Gold Medals in the Latest Physics Olympiads with a Coevolutionary Multimodal Multi-Agent Systemcited by 7
  23. 2025SCI-Verifier: Scientific Verifier with Thinkingcited by 6
  24. 2024Robust SVD Made Easy: A fast and reliable algorithm for large-scale data analysiscited by 4
  25. 2025Reasoning Vectors: Transferring Chain-of-Thought Capabilities via Task Arithmeticcited by 4
  26. 2025Tracing and Mitigating Hallucinations in Multimodal LLMs via Dynamic Attention Localizationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026REDaCT: Collapse-Free Unlearning in Large Reasoning Models
  2. 2026Exploring and Bridging Knowledge Holes in Unlearned Multimodal Large Language Models
  3. 2026Making LLMs Truly Forget: Deep Unlearning by Searching, Selecting, and Severing Knowledge Paths
  4. 2026Selective Forgetting for Large Reasoning Models
  5. 2025BLUR: A Benchmark for LLM Unlearning Robust to Forget-Retain Overlap
  6. 2026GUARD: Natural Forgetting in Large Reasoning Models via Guided Answer-Reasoning Distillation
  7. 2025SafeEraser: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning
  8. 2025Unlearning That Lasts: Utility-Preserving, Robust, and Almost Irreversible Forgetting in LLMs