mlsanityData to 14 Oct 2026

LaRe: Latent Refocusing for Multimodal Reasoning

arXiv 2511.02360 ↗First posted 4 Nov 2025cs.CV cs.CLcited by 8

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Chain of Thought (CoT) reasoning enhances logical performance by decomposing complex tasks, yet its multimodal extension faces a trade-off. The prevailing Thinking with Images paradigm achieves visual refocusing by explicitly cropping image regions, yet incurs rapidly growing computational overhead. The emerging line of latent-space reasoning reduces token consumption, but lacks the capacity for dynamic refocusing. We argue that this trade-off stems from a tacitly accepted premise that effective visual refocusing must occur in the form of explicit tokens. Building on this, we propose Latent Refocusing (LaRe), a new multimodal reasoning paradigm in which visual refocusing takes place entirely within the latent space. We further design a semantic augmentation training strategy that ensures the semantic structure of the latent space through visual reconstruction objective. Experimental evaluations demonstrate that LaRe improves average accuracy by 7.6% compared to existing baselines while reducing the number of tokens required for inference by 59.7%. When scaled to a 8B-parameter Vision-Language Model backbone, LaRe achieves performance comparable to state-of-the-art methods, demonstrating the efficacy of our proposed latent refocusing paradigm for multimodal reasoning.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 39 references that are in the map. First posted on arXiv 4 Nov 2025.

Builds on

30 of 39 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  2. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
  3. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  4. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  5. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding9 Jan
  6. 2024MiCEval: Unveiling Multimodal Chain of Thought's Quality via Image Description and Reasoning Steps18 Oct
  7. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
  8. 2023Chain of Images for Intuitively Reasoning9 Nov
  9. 2023Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillings3 May
  10. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep

Other references · 20

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  5. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
  6. 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
  7. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
  8. 2022Multimodal Learning with Transformers: A Surveycited by 400
  9. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
  10. 2025Reasoning with Latent Thoughts: On the Power of Looped Transformerscited by 240
  11. 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Datacited by 174
  12. 2021PonderNet: Learning to Pondercited by 168
8 more
  1. 2025Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Spacecited by 117
  2. 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 116
  3. 2024Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMscited by 96
  4. 2025Token Assorted: Mixing Latent and Text Tokens for Improved Language Model Reasoningcited by 91
  5. 2025Seek in the Dark: Reasoning via Test-Time Instance-Level Policy Gradient in Latent Spacecited by 43
  6. 2025Implicit Reasoning in Large Language Models: A Comprehensive Surveycited by 43
  7. 2025Enhancing Latent Computation in Transformers with Latent Tokenscited by 14
  8. 2025Latent Preference Coding: Aligning Large Language Models via Discrete Latent Codescited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
  2. 2026Visual Enhanced Depth Scaling for Multimodal Latent Reasoning
  3. 2025v1: Learning to Point Visual Tokens for Multimodal Grounded Reasoning
  4. 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning
  5. 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Models
  6. 2026Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning
  7. 2026Retrieved Images as Visual Thought: Training-Free Multimodal In-Context Learning for the Open-vs-Closed Gap
  8. 2026Beyond Visual Memory: Mechanistic Diagnostics of Latent Visual Reasoning