Thinking with Novel Views: A Systematic Analysis of Generative-Augmented Spatial Intelligence
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Current Large Multimodal Models (LMMs) struggle with spatial reasoning tasks requiring viewpoint-dependent understanding, largely because they are confined to a single, static observation. We propose Thinking with Novel Views (TwNV), a paradigm that integrates generative novel-view synthesis into the reasoning loop: a Reasoner LMM identifies spatial ambiguity, instructs a Painter to synthesize an alternative viewpoint, and re-examines the scene with the additional evidence. Through systematic experiments we address three research questions. (1) Instruction format: numerical camera-pose specifications yield more reliable view control than free-form language. (2) Generation fidelity: synthesized view quality is tightly coupled with downstream spatial accuracy. (3) Inference-time visual scaling: iterative multi-turn view refinement further improves performance, echoing recent scaling trends in language reasoning. Across four spatial subtask categories and four LMM architectures (both closed- and open-source), TwNV consistently improves accuracy by +1.3 to +3.9 pp, with the largest gains on viewpoint-sensitive subtasks. These results establish novel-view generation as a practical lever for advancing spatial intelligence of LMMs.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 35 of its 40 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
35 of 40 references.
Closest ancestors · 8
Same direction, newest first
- 2026Think3D: Thinking with Space for Spatial Reasoning19 Jan
- 2026CoV: Chain-of-View Prompting for Spatial Reasoning8 Jan
- 2025Geometrically-Constrained Agent for Spatial Reasoning27 Nov
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
- 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
Other references · 27
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Visual Instruction Tuningcited by 7,792
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2025Qwen-Image Technical Reportcited by 973
- 2025OpenAI GPT-5 System Cardcited by 910
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
15 more
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
- 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 146
- 2025Visual Spatial Tuningcited by 85
- 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 75
- 2026Image Generators are Generalist Vision Learnerscited by 40
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 20
- 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generationcited by 19
- 2025PreciseCam: Precise Camera Control for Text-to-Image Generationcited by 13
- 2024MVImgNet2.0: A Larger-scale Dataset of Multi-view Imagescited by 12
- 2025DualCamCtrl: Dual-Branch Diffusion Model for Geometry-Aware Camera-Controlled Video Generationcited by 11
- 2025Abstract 3D Perception for Spatial Intelligence in Vision-Language Modelscited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoning
- 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
- 2026Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models
- 2025Reasoning Path and Latent State Analysis for Multi-view Visual Spatial Reasoning: A Cognitive Science Perspective
- 2026When More Is Less: A Systematic Analysis of Spatial and Commonsense Information for Visual Spatial Reasoning
- 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
- 2026Exploring Spatial Intelligence from a Generative Perspective
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks