Remember-R1: Mitigating Long-Context Visual Forgetting through Reinforcement Learning
On the map: LLM reasoning → Multimodal reasoning
also in 2 more
Abstract (arXiv)
Multimodal large language models (MLLMs) increasingly rely on long chain-of-thought reasoning for complex tasks. However, as reasoning sequences lengthen, models may gradually rely less on visual evidence and more on accumulated textual context, leading to visual forgetting. Existing approaches do not directly constrain how visual evidence is used and maintained along the original reasoning trajectory, leaving long-context visual forgetting insufficiently addressed. To address this issue, we propose Remember-R1, a reinforcement learning framework that mitigates long-context visual forgetting by applying process-level supervision directly on the original reasoning trajectory. Specifically, Remember-R1 introduces rewards that encourage broader coverage of matched visual keywords, stronger persistence of visual dependence in later reasoning steps, and greater focus on question-relevant image regions. Experiments across multiple model scales and diverse multimodal benchmarks demonstrate that Remember-R1 consistently improves reasoning performance. Additional analyses further show that it slows the decline of visual attention during generation, supporting its effectiveness in mitigating long-context visual forgetting.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 30 references that are in the map. First posted on arXiv 2 Aug 2026.
Builds on
20 of 30 references.
Closest ancestors · 8
Same direction, newest first
- 2026PaLMR: Towards Faithful Visual Reasoning via Multimodal Process Alignment28 Feb
- 2025Robust-R1: Degradation-Aware Reasoning for Robust Visual Understanding19 Dec
- 2025DeepSketcher: Internalizing Visual Manipulation for Multimodal Reasoning30 Sep
- 2025Look-Back: Implicit Visual Re-focusing in MLLM Reasoning2 Jul
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025Mitigating Visual Forgetting via Take-along Visual Conditioning for Multi-modal Long CoT Reasoning17 Mar
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
Other references · 12
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
- 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 176
- 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Groundingcited by 83
- 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 49
- 2025LPO: Towards Accurate GUI Agent Interaction via Location Preference Optimizationcited by 16
- 2026Response-G1: Explicit Scene Graph Modeling for Proactive Streaming Video Understandingcited by 2
- 2026Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding?cited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Visually-Guided Policy Optimization for Multimodal Reasoning
- 2026LASER: A Corrective Lens for LVLMs via Visual Attention Preservation and Sink Suppression
- 2026ReMAP: Restoring the Perceptual Cycle with Reasoning-Time Latent Visual Memory
- 2026Do MLLMs Really See It: Reinforcing Visual Attention in Multimodal LLMs
- 2026Leveraging Latent Visual Reasoning in Silence
- 2026When Thinking Hurts: Mitigating Visual Forgetting in Video Reasoning via Frame Repetition
- 2025More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Models
- 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention