mlsanityData to 7 Oct 2026

Thinking with Novel Views: A Systematic Analysis of Generative-Augmented Spatial Intelligence

arXiv 2605.10588 ↗First posted 11 May 2026cs.CVcited by 1

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Current Large Multimodal Models (LMMs) struggle with spatial reasoning tasks requiring viewpoint-dependent understanding, largely because they are confined to a single, static observation. We propose Thinking with Novel Views (TwNV), a paradigm that integrates generative novel-view synthesis into the reasoning loop: a Reasoner LMM identifies spatial ambiguity, instructs a Painter to synthesize an alternative viewpoint, and re-examines the scene with the additional evidence. Through systematic experiments we address three research questions. (1) Instruction format: numerical camera-pose specifications yield more reliable view control than free-form language. (2) Generation fidelity: synthesized view quality is tightly coupled with downstream spatial accuracy. (3) Inference-time visual scaling: iterative multi-turn view refinement further improves performance, echoing recent scaling trends in language reasoning. Across four spatial subtask categories and four LMM architectures (both closed- and open-source), TwNV consistently improves accuracy by +1.3 to +3.9 pp, with the largest gains on viewpoint-sensitive subtasks. These results establish novel-view generation as a practical lever for advancing spatial intelligence of LMMs.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 35 of its 40 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

35 of 40 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026Think3D: Thinking with Space for Spatial Reasoning19 Jan
  2. 2026CoV: Chain-of-View Prompting for Spatial Reasoning8 Jan
  3. 2025Geometrically-Constrained Agent for Spatial Reasoning27 Nov
  4. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
  5. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
  6. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec
  7. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
  8. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan

Other references · 27

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  7. 2025Qwen-Image Technical Reportcited by 973
  8. 2025OpenAI GPT-5 System Cardcited by 910
  9. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  10. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  11. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  12. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
15 more
  1. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  2. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  3. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
  4. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  5. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
  6. 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 146
  7. 2025Visual Spatial Tuningcited by 85
  8. 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 75
  9. 2026Image Generators are Generalist Vision Learnerscited by 40
  10. 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 20
  11. 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generationcited by 19
  12. 2025PreciseCam: Precise Camera Control for Text-to-Image Generationcited by 13
  13. 2024MVImgNet2.0: A Larger-scale Dataset of Multi-view Imagescited by 12
  14. 2025DualCamCtrl: Dual-Branch Diffusion Model for Geometry-Aware Camera-Controlled Video Generationcited by 11
  15. 2025Abstract 3D Perception for Spatial Intelligence in Vision-Language Modelscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoning
  2. 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
  3. 2026Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models
  4. 2025Reasoning Path and Latent State Analysis for Multi-view Visual Spatial Reasoning: A Cognitive Science Perspective
  5. 2026When More Is Less: A Systematic Analysis of Spatial and Commonsense Information for Visual Spatial Reasoning
  6. 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
  7. 2026Exploring Spatial Intelligence from a Generative Perspective
  8. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks