LEMUR: Latent Entropy-aware Multimodal Unlearning via Visual-anchored Reasoning Redirection
On the map: LLM reasoning → Reinforcement learning for reasoning
also in 1 more
Abstract (arXiv)
Reinforcement-learning (RL) post-training equips multimodal large reasoning models (MLRMs) with exploratory chains of thought (CoT), substantially improving visual reasoning. However, we find that this capability introduces a distinct privacy vulnerability: even when a sensitive fact is successfully unlearned from the final answer, the model may still reproduce it in its reasoning trace. This leakage is substantially more pronounced in natively RL-trained MLRMs than in their non -reasoning base models, revealing a privacy risk that existing unlearning methods are not designed to address. We show that RL-induced exploration leaves sensitive content with a distinctive token-level entropy signature that is largely absent from base models. Based on this observation, we propose LEMUR, a fully training-free, inference-time unlearning framework for natively RL-trained multimodal models. LEMUR uses entropy dynamics as a control signal to identify when sensitive reasoning begins and when sanitization should stop. During this interval, it redirects the reasoning trajectory through entropy-modulated visual-anchor latent injection, replacing committed tokens with sanitized, probability-weighted embeddings re-grounded in the input image. Across diverse MLRMs, LEMUR consistently outperforms existing unlearning met hods in suppressing both reasoning-trace and answer leakage, while better preserving non-sensitive utility and output fluency. These results demonstrate that RL-induced entropy dynamics provide a distinctive signal for privacy leakage and that exploiting this signal enables effective training-free unlearning for reasoning-capable multimodal models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 11 of its 27 references that are in the map. First posted on arXiv 12 Aug 2026.
Builds on
11 of 27 references.
Closest ancestors · 1
Same direction, newest first
Other references · 10
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024OpenAI o1 System Cardcited by 1,244
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 504
- 2023In-Context Unlearning: Language Models as Few Shot Unlearnerscited by 224
- 2024Guardrail Baselines for Unlearning in LLMscited by 96
- 2024Offset Unlearning for Large Language Modelscited by 36
- 2025Closing the Safety Gap: Surgical Concept Erasure in Visual Autoregressive Modelscited by 9
- 2026Differential Vector Erasure: Unified Training-Free Concept Erasure for Flow Matching Modelscited by 5
- 2026ActErase: A Training-Free Paradigm for Precise Concept Erasure via Activation Redirectioncited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Entropy Is Not Enough: Unlocking Effective Reinforcement Learning for Visual Reasoning via Vision-Anchored Token Selection
- 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
- 2026Not All Tokens Learn Alike: Attention Entropy Reveals Heterogeneous Signals in RL Reasoning
- 2025Beyond High-Entropy Exploration: Correctness-Aware Low-Entropy Segment-Based Advantage Shaping for Reasoning LLMs
- 2025Video Reasoning without Training
- 2025Revisiting Entropy in Reinforcement Learning for Large Reasoning Models
- 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoning
- 2025Rethinking Entropy Regularization in Large Reasoning Models