UniVLR: Unifying Text and Vision in Visual Latent Reasoning for Multimodal LLMs
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multimodal large language models are increasingly expected to perform thinking with images, yet existing visual latent reasoning methods still rely on explicit textual chain-of-thought interleaved with visual latent tokens. This interleaved design limits efficiency and keeps reasoning fragmented across separate text and vision channels. We propose UniVLR, a unified visual latent reasoning framework that treats textual reasoning and auxiliary visual evidence as a shared visual workspace. Instead of preserving text CoT as an independent inference-time path, UniVLR renders reasoning traces together with auxiliary images and learns to compress this unified representation into compact visual latent tokens. At inference time, the model reasons only through visual latents and directly decodes the final answer, avoiding both external tool calls and verbose text reasoning. Experiments on real-world perception and visual reasoning tasks show that UniVLR outperforms prior visual latent reasoning methods while using substantially fewer generated reasoning tokens, suggesting a more unified and efficient paradigm for visual thinking in MLLMs.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 39 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
37 of 39 references.
Closest ancestors · 16
Same direction, newest first
- 2026OneLatent: Single-Token Compression for Visual Latent Reasoning14 Feb
- 2026Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning21 Jan
- 2025Sketch-in-Latents: Eliciting Unified Reasoning in MLLMs18 Dec
- 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space14 Dec
- 2025Monet: Reasoning in Latent Visual Space Beyond Images and Language26 Nov
- 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens24 Nov
- 2025Latent Visual Reasoning29 Sep
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
- 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Use25 May
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
4 more
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 21
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2019Towards VQA Models That Can Readcited by 1,696
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
- 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 779
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
- 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 293
9 more
- 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 284
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
- 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151
- 2023Token Fusion: Bridging the Gap between Token Pruning and Token Mergingcited by 123
- 2025Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Spacecited by 109
- 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Groundingcited by 78
- 2026DeepSeek-OCR 2: Visual Causal Flowcited by 68
- 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlookcited by 40
- 2025TAMP: Token-Adaptive Layerwise Pruning in Multimodal Large Language Modelscited by 9
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026LUT: Latent Utility Training for Visual Reasoningcited by 2
- 2026Reason Through the Latent! Making Latent Visual Reasoning Necessarycited by 1
- 2026Language-Guided Abstraction for Visual Reasoningcited by 0
- 2026ConceptFormer: Learning Adaptive Latent Concepts for Query-Document Alignment in Visual Document Retrievalcited by 0
- 2026Rethinking Latent Visual Reasoning: Grounding Latent Reasoning in Visual Evidencecited by 0
- 2026MoLE: Mixture of Latent Experts for Complementary Visual Reasoningcited by 0
- 2026MoLE: Mixture of Latent Experts for Complementary Visual Reasoning1 Oct 2026
- 2026Rethinking Latent Visual Reasoning: Grounding Latent Reasoning in Visual Evidence28 Sep 2026
- 2026Reason Through the Latent! Making Latent Visual Reasoning Necessary6 Sep 2026
- 2026ConceptFormer: Learning Adaptive Latent Concepts for Query-Document Alignment in Visual Document Retrieval16 Aug 2026
- 2026LUT: Latent Utility Training for Visual Reasoning1 Aug 2026
- 2026Language-Guided Abstraction for Visual Reasoning11 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows
- 2026Distilling Visual Reasoning into Text Space
- 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space
- 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
- 2026GLaQ: Grounding Latent Queries in Visual Evidence for Multimodal Reasoning
- 2026Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMs
- 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning
- 2026See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs