TimeThink: Reasoning with Time for Video LLMs
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Video reasoning requires models to identify and verify temporally localized evidence within long video sequences. Recent Video Large Language Models (Video-LLMs) have shown promising reasoning abilities when aligned with reinforcement learning, yet existing approaches typically rely on outcome-based rewards that supervise only the final prediction. Such supervision provides limited guidance on how models should discover the relevant temporal evidence during intermediate reasoning. In this work, we propose TimeThink, a reinforcement learning framework that explicitly guides temporal evidence discovery in Video-LLMs. Our key idea is to treat temporal clue steps as the fundamental optimization primitive of video reasoning, where each reasoning step references a candidate time interval in the video. We introduce a step-wise temporal process reward that provides localized credit assignment for these clues and a joint process--outcome optimization objective that balances reasoning fidelity with task correctness. To enable scalable training, we construct TimeThink-RFT-20K, a dataset with automatically derived temporal evidence segments. Extensive experiments across video reasoning, temporal grounding, and general video understanding benchmarks show that TimeThink consistently improves both temporal localization and reasoning performance, achieving state-of-the-art results among open-source video RL models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 72 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
43 of 72 references.
Closest ancestors · 6
Same direction, newest first
- 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perception25 Sep
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoning17 Mar
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
Other references · 37
- 2023GPT-4 Technical Reportcited by 18,132
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2024OpenAI o1 System Cardcited by 1,220
25 more
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
- 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 694
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
- 2024Long Context Transfer from Language to Visioncited by 502
- 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 386
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 344
- 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 320
- 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 275
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
- 2023Self-Chained Image-Language Model for Video Localization and Question Answeringcited by 200
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2024MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokenscited by 116
- 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learningcited by 99
- 2024Video-CCAM: Enhancing Video-Language Understanding with Causal Cross-Attention Masks for Short and Long Videoscited by 95
- 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 87
- 2024HawkEye: Training Video-Text LLMs for Grounding Text in Videoscited by 83
- 2024CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understandingcited by 82
- 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
- 2024Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMscited by 35
- 2025TempSamp-R1: Effective Temporal Sampling with Reinforcement Fine-Tuning for Video LLMscited by 15
- 2025ZoomV: Temporal Zoom-in for Efficient Long Video Understandingcited by 10
- 2025Breaking the Encoder Barrier for Seamless Video-Language Understandingcited by 8
- 2024Explore the Limits of Omni-modal Pretraining at Scalecited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MOSS-ChatV: Reinforcement Learning with Process Reasoning Reward for Video Temporal Reasoning
- 2025TimeSearch-R: Adaptive Temporal Search for Long-Form Video Understanding via Self-Verification Reinforcement Learning
- 2026TimeProVe: Propose, then Verify for Efficient Long Video Temporal Reasoning in Activities of Daily Living
- 2026Temporal-Aware Reasoning Optimization for Video Temporal Grounding
- 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
- 2025Thinking with Drafts: Speculative Temporal Reasoning for Efficient Long Video Understanding
- 2026TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMs