mlsanityData to 14 Oct 2026

4DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding

arXiv 2605.05997 ↗First posted 7 May 2026cs.CVcited by 4

On the map: LLM reasoning → Spatial and embodied reasoning

also in 2 more
Abstract (arXiv)

Dynamic spatial reasoning from monocular video is essential for bridging visual intelligence and the physical world, yet remains challenging for vision-language models (VLMs). Prior approaches either verbalize spatial-temporal reasoning entirely as text, which is inherently verbose and imprecise for complex dynamics, or rely on external geometric modules that increase inference complexity without fostering intrinsic model capability. In this paper, we present 4DThinker, the first framework that enables VLMs to "think with 4D" through dynamic latent mental imagery, i.e., internally simulating how scenes evolve within the continuous hidden space. Specifically, we first introduce a scalable, annotation-free data generation pipeline that synthesizes 4D reasoning data from raw videos. We then propose Dynamic-Imagery Fine-Tuning (DIFT), which jointly supervises textual tokens and 4D latents to ground the model in dynamic visual semantics. Building on this, 4D Reinforcement Learning (4DRL) further tackles complex reasoning tasks via outcome-based rewards, restricting policy gradients to text tokens to ensure stable optimization. Extensive experiments across multiple dynamic spatial reasoning benchmarks demonstrate that 4DThinker consistently outperforms strong baselines and offers a new perspective toward 4D reasoning in VLMs. Our code is available at https://github.com/zhangquanchen/4DThinker.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 34 of its 49 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

34 of 49 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments24 Apr
  2. 2026Thinking in Dynamics: How Multimodal Large Language Models Perceive, Track, and Reason Dynamics in Physical 4D World13 Mar
  3. 2026MLLM-4D: Towards Visual-based Spatial-Temporal Intelligence28 Feb
  4. 2025Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Models23 Dec
  5. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
  6. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
  7. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  8. 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning17 Jan
  9. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec

Other references · 25

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  6. 2025OpenAI GPT-5 System Cardcited by 989
  7. 2025SAM 3: Segment Anything with Conceptscited by 906
  8. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
  9. 2023Think before you speak: Training Language Models With Pause Tokenscited by 264
  10. 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 235
  11. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
  12. 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
13 more
  1. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokenscited by 124
  2. 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
  3. 2025Latent Visual Reasoningcited by 104
  4. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
  5. 2025Visual Spatial Tuningcited by 89
  6. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
  7. 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlookcited by 43
  8. 2025Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learningcited by 41
  9. 2025SIFThinker: Spatially-Aware Image Focus for Visual Reasoningcited by 25
  10. 2025DSI-Bench: A Benchmark for Dynamic Spatial Intelligencecited by 23
  11. 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attentioncited by 11
  12. 2026AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstructioncited by 9
  13. 2026EgoReasoner: Learning Egocentric 4D Reasoning via Task-Adaptive Structured Thinkingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs
  2. 2026CL4D: Contrastive Language-4D Pretraining for Vision-Language Reasoning in Dynamic Scenes
  3. 2026Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning
  4. 2026World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning
  5. 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoning
  6. 2025Bridging the Dynamic Perception Gap: Training-Free Draft Chain-of-Thought for Dynamic Multimodal Spatial Reasoning
  7. 2025VLM4D: Towards Spatiotemporal Awareness in Vision Language Models
  8. 2025LAST: LeArning to Think in Space and Time for Generalist Vision-Language Models