Temporal-Aware Reasoning Optimization for Video Temporal Grounding
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multi-modal Large Language Models (MLLMs) have achieved remarkable progress in video temporal grounding with reinforcement learning for generating reasoning paths. However, existing models often produce superficial reasoning, which offers limited guidance for precise temporal localization. This limitation stems from (1) inefficient random exploration and (2) reward functions that focus solely on the answer correctness while ignoring reasoning quality. To address these issues, we propose TaRO (Temporal-Aware Reasoning Optimization), a framework that explicitly enhances the model's ability of thinking with time. First, we introduce a Constructive Reasoning Exploration that leverages pre-generated dense captions to construct reasoning paths grounded in explicit visual cues and timestamps, enabling efficient exploration of high-quality time-aware reasoning. Second, to evaluate reasoning quality, we design a Temporal-Sensitivity Reward. High-quality reasoning should be anchored to specific events and timestamps. If the event boundary under thinking is disrupted, such reasoning should become invalid, leading to a drop in the logit of the reasoning path. We utilize this drop as a critique of reasoning quality. Finally, TaRO follows a progressive curriculum, which starts by utilizing this reward to select better constructed reasoning paths, and evolves to a free exploration phase where the model autonomously generates effective reasoning. Experiments demonstrate that TaRO achieves state-of-the-art performance on VTG benchmarks. Code is available at https://github.com/oceanflowlab/TaRO.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 39 of its 50 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
39 of 50 references.
Closest ancestors · 3
Same direction, newest first
- 2025OneThinker: All-in-one Reasoning Model for Image and Video2 Dec
- 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perception25 Sep
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
Other references · 36
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 946
- 2017Dense-Captioning Events in Videoscited by 789
- 2017Localizing Moments in Video with Natural Languagecited by 660
- 2017TALL: Temporal Activity Localization via Language Querycited by 581
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
- 2018Behavioral Cloning from Observationcited by 482
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
- 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 283
24 more
- 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
- 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 212
- 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 189
- 2020Local-Global Video-Text Interactions for Temporal Groundingcited by 188
- 2022MERLOT Reserve: Neural Script Knowledge through Vision and Language and Soundcited by 184
- 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
- 2018To Find Where You Talk: Temporal Sentence Localization in Video with Attention Based Location Regressioncited by 157
- 2023A Survey of Imitation Learning: Algorithms, Recent Developments, and Challengescited by 145
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuningcited by 99
- 2021Boundary Proposal Network for Two-Stage Natural Language Video Localizationcited by 88
- 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 87
- 2024HawkEye: Training Video-Text LLMs for Grounding Text in Videoscited by 83
- 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 57
- 2024ChatVTG: Video Temporal Grounding via Chat with Video Dialogue Large Language Modelscited by 54
- 2021Adaptive Proposal Generation Network for Temporal Sentence Localization in Videoscited by 42
- 2024SnAG: Scalable and Accurate Video Groundingcited by 36
- 2025Universal Video Temporal Grounding with Generative Multi-modal Large Language Modelscited by 26
- 2023Scanning Only Once: An End-to-end Framework for Fast Temporal Grounding in Long Videoscited by 23
- 2025ToolVQA: A Dataset for Multi-step Reasoning VQA with External Toolscited by 13
- 2025Advancing 3D Scene Understanding with MV-ScanQA Multi-View Reasoning Evaluation and TripAlign Pre-training Datasetcited by 8
- 2025Hierarchical Event Memory for Accurate and Low-latency Online Video Temporal Groundingcited by 5
- 2025AR-VRM: Imitating Human Motions for Visual Robot Manipulation with Analogical Reasoningcited by 5
- 2026OmniVTG: A Large-Scale Dataset and Training Paradigm for Open-World Video Temporal Groundingcited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025TAR: Temporal Anchor-Constrained Reasoning for Video Temporal Grounding
- 2026TimeThink: Reasoning with Time for Video LLMs
- 2025MUSEG: Reinforcing Video Temporal Understanding via Timestamp-Aware Multi-Segment Grounding
- 2026Incentivizing Temporal-Awareness in Egocentric Video Understanding Models
- 2025Datasets and Recipes for Video Temporal Grounding via Reinforcement Learning
- 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
- 2025Tempo-R0: A Video-MLLM for Temporal Video Grounding through Efficient Temporal Sensing Reinforcement Learning
- 2025TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement Learning