mlsanityData to 7 Oct 2026

UniVLR: Unifying Text and Vision in Visual Latent Reasoning for Multimodal LLMs

arXiv 2605.11856 ↗First posted 12 May 2026cs.CV cs.CLcited by 6

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Multimodal large language models are increasingly expected to perform thinking with images, yet existing visual latent reasoning methods still rely on explicit textual chain-of-thought interleaved with visual latent tokens. This interleaved design limits efficiency and keeps reasoning fragmented across separate text and vision channels. We propose UniVLR, a unified visual latent reasoning framework that treats textual reasoning and auxiliary visual evidence as a shared visual workspace. Instead of preserving text CoT as an independent inference-time path, UniVLR renders reasoning traces together with auxiliary images and learns to compress this unified representation into compact visual latent tokens. At inference time, the model reasons only through visual latents and directly decodes the final answer, avoiding both external tool calls and verbose text reasoning. Experiments on real-world perception and visual reasoning tasks show that UniVLR outperforms prior visual latent reasoning methods while using substantially fewer generated reasoning tokens, suggesting a more unified and efficient paradigm for visual thinking in MLLMs.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 39 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

37 of 39 references.

Closest ancestors · 16

Same direction, newest first

  1. 2026OneLatent: Single-Token Compression for Visual Latent Reasoning14 Feb
  2. 2026Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning21 Jan
  3. 2025Sketch-in-Latents: Eliciting Unified Reasoning in MLLMs18 Dec
  4. 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space14 Dec
  5. 2025Monet: Reasoning in Latent Visual Space Beyond Images and Language26 Nov
  6. 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens24 Nov
  7. 2025Latent Visual Reasoning29 Sep
  8. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
  9. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
  10. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
  11. 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Use25 May
  12. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
4 more
  1. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  2. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
  3. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
  4. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct

Other references · 21

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2019Towards VQA Models That Can Readcited by 1,696
  5. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  6. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
  7. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 779
  8. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  9. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
  10. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  11. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
  12. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 293
9 more
  1. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 284
  2. 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
  3. 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151
  4. 2023Token Fusion: Bridging the Gap between Token Pruning and Token Mergingcited by 123
  5. 2025Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Spacecited by 109
  6. 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Groundingcited by 78
  7. 2026DeepSeek-OCR 2: Visual Causal Flowcited by 68
  8. 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlookcited by 40
  9. 2025TAMP: Token-Adaptive Layerwise Pruning in Multimodal Large Language Modelscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows
  2. 2026Distilling Visual Reasoning into Text Space
  3. 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space
  4. 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
  5. 2026GLaQ: Grounding Latent Queries in Visual Evidence for Multimodal Reasoning
  6. 2026Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMs
  7. 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning
  8. 2026See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs