mlsanityData to 7 Oct 2026

How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoning

arXiv 2605.27310 ↗First posted 26 May 2026cs.CVcited by 2

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Cross-view spatial reasoning remains a weak spot for vision-language models (VLMs): they reason in language and discard the fine-grained geometry the task requires. Thinking with images aims to fix this by generating an intermediate thinking-image, but recent work shows the visual evidence in these traces is largely ignored. We therefore ask how to make visual thinking matter, and what kind of visual thinking works best. We ask these questions for unified multimodal models (UMMs) that natively support interleaved image-text generation. For the how, we propose View Dropout (VDrop), a training-time intervention that hides parts of one input view from the answer span while leaving it visible to the thinking-image tokens. This incentivizes the model to make use of the thinking-image when answering, rather than answering based on the input views only. With the thinking-image now being used in answer prediction, we ask which kind of visual thinking works best. We frame this as a Learnability-Informativeness (L-I) tradeoff and compare three thinking-image variants: top-down, panoramic, and point-matching renderings. Trained on synthetic scenes and evaluated on five real-world out-of-domain benchmarks, panoramic visual thinking with VDrop is the only configuration that is simultaneously informative and learnable, and achieves the best out-of-domain generalization.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 10 of its 41 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

10 of 41 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoning9 Feb
  2. 2026Think3D: Thinking with Space for Spatial Reasoning19 Jan

Other references · 8

  1. 2025Qwen3-VL Technical Reportcited by 2,534
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  3. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  4. 2026SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecturecited by 27
  5. 2025On the Faithfulness of Visual Thinking: Measurement and Enhancementcited by 17
  6. 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generationcited by 17
  7. 2025Towards Cross-View Point Correspondence in Vision-Language Modelscited by 12
  8. 2026Communicating about Space: Language-Mediated Spatial Integration Across Partial Viewscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing
  2. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought
  3. 2025Understand, Think, and Answer: Advancing Visual Reasoning with Large Multimodal Models
  4. 2026When More Is Less: A Systematic Analysis of Spatial and Commonsense Information for Visual Spatial Reasoning
  5. 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
  6. 2025Thinking with Generated Images
  7. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models
  8. 2025Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thought