mlsanityData to 14 Oct 2026

Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

arXiv 2606.26631 ↗First posted 25 Jun 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Interleaved multimodal reasoning improves visual grounding by revisiting visual evidence during multi-step generation, yet existing methods typically rely on token replay, repeatedly forwarding selected visual tokens. A natural shortcut is to reuse the historical visual key-value (KV) cache directly. However, we identify a critical failure mode of this strategy: cached visual keys are already bound to their original positional context. Such stale positional binding distorts attention under later decoding contexts and can trigger severe autoregressive decoding collapse. This failure suggests that effective cache reuse requires reconstructing visual evidence under positions compatible with the current decoding state, rather than directly copying position-bound historical cache entries. To this end, we propose Position Rebinding Cache Reuse (PRCR), a cache-level framework for replay-free visual revisiting. PRCR stores raw visual KV cache together with their original spatial coordinates, then reassigns position-compatible coordinates to select entries and rebinds their keys before injecting the reconstructed cache into the active decoder cache. This design reuses historical visual evidence while preserving textual positional continuity and relative visual structure. Experiments across multiple multimodal reasoning benchmarks show that PRCR achieves replay-level or better performance, improving average accuracy by 5 percent and reducing visual-revisiting computation by up to tens of thousands of times.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 42 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

12 of 42 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026Beyond Static Visual Tokens: Structured Sequential Visual Chain-of-Thought Reasoning21 Mar
  2. 2025Latent Sketchpad: Sketching Visual Thoughts to Elicit Multimodal Reasoning in MLLMs28 Oct
  3. 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space14 Oct
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  5. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning1 Jul
  6. 2025VLM-R3: Region Recognition, Reasoning, and Refinement for Enhanced Multimodal Chain-of-Thought22 May
  7. 2025Kimi-VL Technical Report10 Apr
  8. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb

Other references · 4

  1. 2025Qwen3-VL Technical Reportcited by 2,793
  2. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  3. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  4. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Kamera: Unified Position-Invariant Multimodal KV Cache for Training-Free Reuse
  2. 2026ReMAP: Restoring the Perceptual Cycle with Reasoning-Time Latent Visual Memory
  3. 2026FOVEA: Focused On-Demand Visual Evidence Adaptation for Cache-Friendly Multimodal Speculative Decoding
  4. 2026Latent Visual Cache for Video Reasoning
  5. 2026Improving Visual Reasoning with Iterative Evidence Refinement
  6. 2026Look on Demand: A Cognitive Scheduling Framework for Visual Evidence Acquisition in Multimodal Reasoning
  7. 2026VisionPulse: Dynamic Visual Sparsity for Efficient Multimodal Reasoning
  8. 2026Look Back, Think Ahead: Visual Memory on Demand for Efficient Multimodal Reasoning