LaRe: Latent Refocusing for Multimodal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Chain of Thought (CoT) reasoning enhances logical performance by decomposing complex tasks, yet its multimodal extension faces a trade-off. The prevailing Thinking with Images paradigm achieves visual refocusing by explicitly cropping image regions, yet incurs rapidly growing computational overhead. The emerging line of latent-space reasoning reduces token consumption, but lacks the capacity for dynamic refocusing. We argue that this trade-off stems from a tacitly accepted premise that effective visual refocusing must occur in the form of explicit tokens. Building on this, we propose Latent Refocusing (LaRe), a new multimodal reasoning paradigm in which visual refocusing takes place entirely within the latent space. We further design a semantic augmentation training strategy that ensures the semantic structure of the latent space through visual reconstruction objective. Experimental evaluations demonstrate that LaRe improves average accuracy by 7.6% compared to existing baselines while reducing the number of tokens required for inference by 59.7%. When scaled to a 8B-parameter Vision-Language Model backbone, LaRe achieves performance comparable to state-of-the-art methods, demonstrating the efficacy of our proposed latent refocusing paradigm for multimodal reasoning.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 39 references that are in the map. First posted on arXiv 4 Nov 2025.
Builds on
30 of 39 references.
Closest ancestors · 10
Same direction, newest first
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding9 Jan
- 2024MiCEval: Unveiling Multimodal Chain of Thought's Quality via Image Description and Reasoning Steps18 Oct
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2023Chain of Images for Intuitively Reasoning9 Nov
- 2023Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillings3 May
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
Other references · 20
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
- 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2022Multimodal Learning with Transformers: A Surveycited by 400
- 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
- 2025Reasoning with Latent Thoughts: On the Power of Looped Transformerscited by 240
- 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Datacited by 174
- 2021PonderNet: Learning to Pondercited by 168
8 more
- 2025Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Spacecited by 117
- 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 116
- 2024Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMscited by 96
- 2025Token Assorted: Mixing Latent and Text Tokens for Improved Language Model Reasoningcited by 91
- 2025Seek in the Dark: Reasoning via Test-Time Instance-Level Policy Gradient in Latent Spacecited by 43
- 2025Implicit Reasoning in Large Language Models: A Comprehensive Surveycited by 43
- 2025Enhancing Latent Computation in Transformers with Latent Tokenscited by 14
- 2025Latent Preference Coding: Aligning Large Language Models via Discrete Latent Codescited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlookcited by 43
- 2026Forest Before Trees: Latent Superposition for Efficient Visual Reasoningcited by 18
- 2026Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMscited by 6
- 2026The Thinking Pixel: Recursive Sparse Reasoning in Multimodal Diffusion Latentscited by 2
- 2026ReGuLaR: Relation-Grounded Latent Reasoning for Large Vision-Language Modelscited by 2
- 2026DeepLatent: Think with Images via Parallel Latent Visual Reasoningcited by 1
- 2025SCS-SupCon: Sigmoid-based Common and Style Supervised Contrastive Learning with Adaptive Decision Boundariescited by 0
- 2026Eye-Q: A Multilingual Benchmark for Visual Word Puzzle Solving and Image-to-Phrase Reasoningcited by 0
- 2026DeepLatent: Think with Images via Parallel Latent Visual Reasoning30 May 2026
- 2026ReGuLaR: Relation-Grounded Latent Reasoning for Large Vision-Language Models28 May 2026
- 2026Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMs4 May 2026
- 2026The Thinking Pixel: Recursive Sparse Reasoning in Multimodal Diffusion Latents28 Apr 2026
- 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlook2 Apr 2026
- 2026Forest Before Trees: Latent Superposition for Efficient Visual Reasoning11 Jan 2026
- 2026Eye-Q: A Multilingual Benchmark for Visual Word Puzzle Solving and Image-to-Phrase Reasoning6 Jan 2026
- 2025SCS-SupCon: Sigmoid-based Common and Style Supervised Contrastive Learning with Adaptive Decision Boundaries17 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
- 2026Visual Enhanced Depth Scaling for Multimodal Latent Reasoning
- 2025v1: Learning to Point Visual Tokens for Multimodal Grounded Reasoning
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning
- 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Models
- 2026Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning
- 2026Retrieved Images as Visual Thought: Training-Free Multimodal In-Context Learning for the Open-vs-Closed Gap
- 2026Beyond Visual Memory: Mechanistic Diagnostics of Latent Visual Reasoning