4DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding
On the map: LLM reasoning → Spatial and embodied reasoning
also in 2 more
Abstract (arXiv)
Dynamic spatial reasoning from monocular video is essential for bridging visual intelligence and the physical world, yet remains challenging for vision-language models (VLMs). Prior approaches either verbalize spatial-temporal reasoning entirely as text, which is inherently verbose and imprecise for complex dynamics, or rely on external geometric modules that increase inference complexity without fostering intrinsic model capability. In this paper, we present 4DThinker, the first framework that enables VLMs to "think with 4D" through dynamic latent mental imagery, i.e., internally simulating how scenes evolve within the continuous hidden space. Specifically, we first introduce a scalable, annotation-free data generation pipeline that synthesizes 4D reasoning data from raw videos. We then propose Dynamic-Imagery Fine-Tuning (DIFT), which jointly supervises textual tokens and 4D latents to ground the model in dynamic visual semantics. Building on this, 4D Reinforcement Learning (4DRL) further tackles complex reasoning tasks via outcome-based rewards, restricting policy gradients to text tokens to ensure stable optimization. Extensive experiments across multiple dynamic spatial reasoning benchmarks demonstrate that 4DThinker consistently outperforms strong baselines and offers a new perspective toward 4D reasoning in VLMs. Our code is available at https://github.com/zhangquanchen/4DThinker.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 34 of its 49 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
34 of 49 references.
Closest ancestors · 9
Same direction, newest first
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments24 Apr
- 2026Thinking in Dynamics: How Multimodal Large Language Models Perceive, Track, and Reason Dynamics in Physical 4D World13 Mar
- 2026MLLM-4D: Towards Visual-based Spatial-Temporal Intelligence28 Feb
- 2025Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Models23 Dec
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning17 Jan
- 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec
Other references · 25
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025OpenAI GPT-5 System Cardcited by 989
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2023Think before you speak: Training Language Models With Pause Tokenscited by 264
- 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 235
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
13 more
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokenscited by 124
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 2025Latent Visual Reasoningcited by 104
- 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
- 2025Visual Spatial Tuningcited by 89
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
- 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlookcited by 43
- 2025Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learningcited by 41
- 2025SIFThinker: Spatially-Aware Image Focus for Visual Reasoningcited by 25
- 2025DSI-Bench: A Benchmark for Dynamic Spatial Intelligencecited by 23
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attentioncited by 11
- 2026AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstructioncited by 9
- 2026EgoReasoner: Learning Egocentric 4D Reasoning via Task-Adaptive Structured Thinkingcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillationcited by 0
- 2026EviViT: Evidence-Adaptive Vision Transformers for Fine-Grained Perceptioncited by 0
- 2026HaPRL: Human-Anchored Process Reinforcement Learning for Visual Search Agentcited by 0
- 2026DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoningcited by 0
- 2026DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoning14 Oct 2026
- 2026HaPRL: Human-Anchored Process Reinforcement Learning for Visual Search Agent29 Sep 2026
- 2026EviViT: Evidence-Adaptive Vision Transformers for Fine-Grained Perception29 Sep 2026
- 2026Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillation29 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs
- 2026CL4D: Contrastive Language-4D Pretraining for Vision-Language Reasoning in Dynamic Scenes
- 2026Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning
- 2026World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning
- 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoning
- 2025Bridging the Dynamic Perception Gap: Training-Free Draft Chain-of-Thought for Dynamic Multimodal Spatial Reasoning
- 2025VLM4D: Towards Spatiotemporal Awareness in Vision Language Models
- 2025LAST: LeArning to Think in Space and Time for Generalist Vision-Language Models