Motion-o: Trajectory-Grounded Video Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent video reasoning models increasingly produce spatio-temporal evidence chains that localize objects at specific timestamps. While these traces improve interpretability by grounding where and when evidence appears, they often leave the motion connecting observations, the textithow, implicit. This makes dynamic and trajectory-dependent claims difficult to supervise, verify, or penalize when unsupported by the video. We formalize this missing component as Spatial-Temporal-Trajectory (STT) reasoning and introduce Motion-o, a motion-centric extension to vision-language models (VLMs) that makes trajectories explicit and verifiable. Motion-o augments evidence chains with Motion Chain of Thought (MCoT), a structured pathway that represents object motion through a discrete texttt<motion/> tag summarizing direction, speed, and scale change. To supervise MCoT, we densify sparse spatio-temporal annotations into object tracks and derive motion descriptors from centroid displacement and box-area change. We then train with complementary rewards for trajectory consistency and visual grounding, including a perturbation-based signal that penalizes motion descriptions that remain unchanged when temporal evidence is removed. Across multiple video understanding benchmarks, Motion-o consistently improves trajectory-faithful reasoning without architectural modifications. These results suggest that an explicit motion interface can complement existing VLM pipelines by converting implicit dynamics into verifiable evidence. Code is available at~hrefhttps://github.com/ostadabbas/Motion-ofaGithub textttostadabbas/Motion-o.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 28 of its 30 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
28 of 30 references.
Closest ancestors · 9
Same direction, newest first
- 2025Thinking With Bounding Boxes: Enhancing Spatio-Temporal Video Grounding via Reinforcement Fine-Tuning26 Nov
- 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidence23 Oct
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning9 Jul
- 2025VGR: Visual Grounded Reasoning13 Jun
- 2025GRIT: Teaching MLLMs to Think with Images21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
Other references · 19
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2025Group Sequence Policy Optimizationcited by 788
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 352
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 152
- 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 147
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2025PerceptionLM: Open-Access Data and Models for Detailed Visual Understandingcited by 88
- 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
- 2025MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Modelscited by 69
7 more
- 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 67
- 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 57
- 2025Datasets and Recipes for Video Temporal Grounding via Reinforcement Learningcited by 18
- 2025VideoMolmo: Spatio-Temporal Grounding Meets Pointingcited by 14
- 2023VSTAR: A Video-grounded Dialogue Dataset for Situated Semantic Understanding with Scene and Topic Transitionscited by 11
- 2025The Escalator Problem: Identifying Implicit Motion Blindness in AI for Accessibilitycited by 2
- 2025TRoVe: Discovering Error-Inducing Static Feature Biases in Temporal Vision-Language Modelscited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Which Way Did It Move? Diagnosing and Overcoming Directional Motion Blindness in Video-LLMscited by 2
- 2026When Video Misreads: Closed-Loop Distillation of Reading Heuristics for Exploratory Manipulation Trace QAcited by 0
- 2026MotionBlind: Probing the Illusion of Motion Understanding in Video-LLMscited by 0
- 2026MotionBlind: Probing the Illusion of Motion Understanding in Video-LLMs8 Sep 2026
- 2026When Video Misreads: Closed-Loop Distillation of Reading Heuristics for Exploratory Manipulation Trace QA7 Jun 2026
- 2026Which Way Did It Move? Diagnosing and Overcoming Directional Motion Blindness in Video-LLMs21 May 2026
Similar, not cited
Close in wording, no citation either way
- 2024Motion-Grounded Video Reasoning: Understanding and Perceiving Motion at Pixel Level
- 2025FoundationMotion: Auto-Labeling and Reasoning about Spatial Movement in Videos
- 2026Reasoning over Video: Evaluating How MLLMs Extract, Integrate, and Reconstruct Spatiotemporal Evidence
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning
- 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoning
- 2025Know-Show: Benchmarking Video-Language Models on Spatio-Temporal Grounded Reasoning
- 2026StateTrace: An Object-Centric Framework for Hidden-State Spatiotemporal Reasoning in Long Videos
- 2026STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Models