Dyn-3D: Unveiling and Resolving Ego-Motion Ambiguity in Vision-Language Models
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
As Vision-Language Models (VLMs) tackle dynamic 3D spatial reasoning, ego-motion perception becomes essential to resolve monocular scale ambiguity. However, current models often overfit to smooth trajectory priors rather than genuinely understanding physical motion. Consequently, their spatial reasoning degrades severely under large displacements, a phenomenon we term Kinematic Collapse. This failure stems from spurious visual-motion correlations in natural videos and a lack of explicit physical supervision. To evaluate this, we introduce Dyn-3D, a benchmark using counterfactual 3D rendering to rigorously decouple visual changes from true kinematic properties. Furthermore, we propose the TempoVista framework, featuring the Kinematic-GSPO algorithm. By embedding metric physical ground truth into policy optimization, TempoVista explicitly grounds visual representations in 3D space. Experiments demonstrate that our approach significantly improves both motion estimation and robust spatial reasoning by utilizing camera dynamics as an effective geometric calibration signal.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 30 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
24 of 30 references.
Closest ancestors · 2
Same direction, newest first
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
Other references · 22
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
10 more
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
- 2021Embodied Intelligence via Learning and Evolutioncited by 163
- 2025ReferSplat: Referring Segmentation in 3D Gaussian Splattingcited by 20
- 2025ExtrinSplat: Decoupling Geometry and Semantics for Open-Vocabulary Understanding in 3D Gaussian Splattingcited by 6
- 2026EgoTL: Egocentric Think-Aloud Chains for Long-Horizon Taskscited by 3
- 2026ZeroSplat: Generalized Referring Segmentation in 3D Gaussian Splattingcited by 3
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialoguecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Feeling the Space: Egomotion-Aware Video Representation for Efficient and Accurate 3D Scene Understanding
- 2026GeomVLA: Unifying Scene, Motion, and Action in 3D
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs
- 2025MASS: Motion-Aware Spatial-Temporal Grounding for Physics Reasoning and Comprehension in Vision-Language Models
- 2026EgoMotion: Hierarchical Reasoning and Diffusion for Egocentric Vision-Language Motion Generation
- 20263DWay: Generalizing Robot Manipulation via 3D Consistent Waypoints
- 2026MotionVLA: Injecting Geometric Motion into Vision-Language-Action Model
- 2025Abstract 3D Perception for Spatial Intelligence in Vision-Language Models