mlsanityData to 7 Oct 2026

DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs

arXiv 2607.12503 ↗First posted 14 Jul 2026cs.CVcited by 1

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

4D spatio-temporal reasoning, jointly modeling 3D spatial structure and temporal evolution, is essential for understanding dynamic worlds and enabling embodied interaction. While current Multimodal Large Language Models (MLLMs) show strong capabilities in static scene understanding and coarse-grained 4D tasks, they still have notable limitations in continuous dynamic scene perception, especially in tracking dynamic object evidence for coherent 4D spatio-temporal reasoning. This shortcoming stems mainly from relying on sparse frame-level observations, fragmenting continuous dynamic cues and leaving models unable to disentangle genuine object dynamics from camera-induced apparent motion. Inspired by humans tracking dynamic cues while compensating for viewpoint changes, we propose DynTrace, a training-free framework for 4D spatio-temporal reasoning with two complementary components. Dynamic Trajectory Visualization (DTV) reprojects world-coordinate trajectories onto the image plane, providing geometry-informed visual priors that disentangle genuine object dynamics from camera-induced apparent motion. Meanwhile, the Dynamic Trace Token (DT-Token), organized into a Dynamic Trace Graph (DTG), tracks object-level dynamic cues, trace evolution, and key moments, maintaining continuous dynamic object evidence for coherent 4D reasoning. Together, these two components equip MLLMs with continuously tracked dynamic object evidence, grounded in geometry-informed visual priors and structured spatio-temporal traces. DynTrace consistently improves open-source MLLMs, achieving state-of-the-art results on Dyn-Bench, VLM4D, and DSI-Bench, validating the importance of tracking dynamic object evidence for robust 4D spatio-temporal reasoning.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 67 references that are in the map. First posted on arXiv 14 Jul 2026.

Builds on

45 of 67 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026RoboStream: Weaving Spatio-Temporal Reasoning with Memory in Vision-Language Models for Robotics13 Mar
  2. 2026Thinking in Dynamics: How Multimodal Large Language Models Perceive, Track, and Reason Dynamics in Physical 4D World13 Mar
  3. 2026MLLM-4D: Towards Visual-based Spatial-Temporal Intelligence28 Feb
  4. 2025Spatial4D-Bench: A Versatile 4D Spatial Intelligence Benchmark31 Dec
  5. 2025Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Models23 Dec
  6. 2025SNOW: Spatio-Temporal Scene Understanding with World Knowledge for Open-World Embodied Reasoning18 Dec
  7. 2025R4: Retrieval-Augmented Reasoning for Vision-Language Models in 4D Spatio-Temporal Space17 Dec
  8. 2025Geometrically-Constrained Agent for Spatial Reasoning27 Nov
  9. 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards10 Nov
  10. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  11. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec

Other references · 34

  1. 2025Qwen3-VL Technical Reportcited by 2,534
  2. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  4. 2025SAM 3: Segment Anything with Conceptscited by 835
  5. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  6. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
  7. 2025Qwen3-Omni Technical Reportcited by 451
  8. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
  9. 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 212
  10. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  11. 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
  12. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
22 more
  1. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
  2. 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 153
  3. 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
  4. 2025Visual Spatial Tuningcited by 85
  5. 2025LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understandingcited by 57
  6. 2025STORM: Token-Efficient Long Video Understanding for Multimodal LLMscited by 46
  7. 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidencecited by 43
  8. 2025Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learningcited by 38
  9. 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligencecited by 34
  10. 2025WAFT: Warping-Alone Field Transforms for Optical Flowcited by 32
  11. 2025VideoExplorer: Think With Videos For Agentic Long-Video Understandingcited by 29
  12. 2025VideoITG: Multimodal Video Understanding with Instructed Temporal Groundingcited by 28
  13. 2025DSI-Bench: A Benchmark for Dynamic Spatial Intelligencecited by 20
  14. 2024LLaVA-MR: Large Language-and-Vision Assistant for Video Moment Retrievalcited by 17
  15. 2025LLaVA-4D: Embedding SpatioTemporal Prompt into LMMs for 4D Scene Understandingcited by 17
  16. 2025See&Trek: Training-Free Spatial Prompting for Multimodal Large Language Modelcited by 13
  17. 2025Learning to Inference Adaptively for Multimodal Large Language Modelscited by 12
  18. 20254D-Bench: Benchmarking Multi-modal Large Language Models for 4D Object Understandingcited by 8
  19. 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Modelscited by 7
  20. 2025UniComp: Rethinking Video Compression Through Informational Uniquenesscited by 7
  21. 2025DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modelingcited by 5
  22. 2026ST-VLA: Enabling 4D-Aware Spatiotemporal Understanding for General Robot Manipulationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding
  2. 2025VLM4D: Towards Spatiotemporal Awareness in Vision Language Models
  3. 20264DVLT: Dynamic Scene Understanding with Worldline-Centered Vision-Language Tracking
  4. 2025Understanding Dynamic Scenes in Ego Centric 4D Point Clouds
  5. 2026Dyn-3D: Unveiling and Resolving Ego-Motion Ambiguity in Vision-Language Models
  6. 2026ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulation
  7. 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialogue
  8. 2026Motion-o: Trajectory-Grounded Video Reasoning