mlsanityData to 7 Oct 2026

Motion-o: Trajectory-Grounded Video Reasoning

arXiv 2603.18856 ↗First posted 19 Mar 2026cs.CV cs.AIcited by 3

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Recent video reasoning models increasingly produce spatio-temporal evidence chains that localize objects at specific timestamps. While these traces improve interpretability by grounding where and when evidence appears, they often leave the motion connecting observations, the textithow, implicit. This makes dynamic and trajectory-dependent claims difficult to supervise, verify, or penalize when unsupported by the video. We formalize this missing component as Spatial-Temporal-Trajectory (STT) reasoning and introduce Motion-o, a motion-centric extension to vision-language models (VLMs) that makes trajectories explicit and verifiable. Motion-o augments evidence chains with Motion Chain of Thought (MCoT), a structured pathway that represents object motion through a discrete texttt<motion/> tag summarizing direction, speed, and scale change. To supervise MCoT, we densify sparse spatio-temporal annotations into object tracks and derive motion descriptors from centroid displacement and box-area change. We then train with complementary rewards for trajectory consistency and visual grounding, including a perturbation-based signal that penalizes motion descriptions that remain unchanged when temporal evidence is removed. Across multiple video understanding benchmarks, Motion-o consistently improves trajectory-faithful reasoning without architectural modifications. These results suggest that an explicit motion interface can complement existing VLM pipelines by converting implicit dynamics into verifiable evidence. Code is available at~hrefhttps://github.com/ostadabbas/Motion-ofaGithub textttostadabbas/Motion-o.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 28 of its 30 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

28 of 30 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Thinking With Bounding Boxes: Enhancing Spatio-Temporal Video Grounding via Reinforcement Fine-Tuning26 Nov
  2. 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidence23 Oct
  3. 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning9 Jul
  4. 2025VGR: Visual Grounded Reasoning13 Jun
  5. 2025GRIT: Teaching MLLMs to Think with Images21 May
  6. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  7. 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
  8. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  9. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar

Other references · 19

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  4. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
  5. 2025Group Sequence Policy Optimizationcited by 788
  6. 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 352
  7. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 152
  8. 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 147
  9. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
  10. 2025PerceptionLM: Open-Access Data and Models for Detailed Visual Understandingcited by 88
  11. 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
  12. 2025MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Modelscited by 69
7 more
  1. 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 67
  2. 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 57
  3. 2025Datasets and Recipes for Video Temporal Grounding via Reinforcement Learningcited by 18
  4. 2025VideoMolmo: Spatio-Temporal Grounding Meets Pointingcited by 14
  5. 2023VSTAR: A Video-grounded Dialogue Dataset for Situated Semantic Understanding with Scene and Topic Transitionscited by 11
  6. 2025The Escalator Problem: Identifying Implicit Motion Blindness in AI for Accessibilitycited by 2
  7. 2025TRoVe: Discovering Error-Inducing Static Feature Biases in Temporal Vision-Language Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Motion-Grounded Video Reasoning: Understanding and Perceiving Motion at Pixel Level
  2. 2025FoundationMotion: Auto-Labeling and Reasoning about Spatial Movement in Videos
  3. 2026Reasoning over Video: Evaluating How MLLMs Extract, Integrate, and Reconstruct Spatiotemporal Evidence
  4. 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning
  5. 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoning
  6. 2025Know-Show: Benchmarking Video-Language Models on Spatio-Temporal Grounded Reasoning
  7. 2026StateTrace: An Object-Centric Framework for Hidden-State Spatiotemporal Reasoning in Long Videos
  8. 2026STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Models