TimeSearch-R: Adaptive Temporal Search for Long-Form Video Understanding via Self-Verification Reinforcement Learning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Temporal search aims to identify a minimal set of relevant frames from tens of thousands based on a given query, serving as a foundation for accurate long-form video understanding. Existing works attempt to progressively narrow the search space. However, these approaches typically rely on a hand-crafted search process, lacking end-to-end optimization for learning optimal search strategies. In this paper, we propose TimeSearch-R, which reformulates temporal search as interleaved text-video thinking, seamlessly integrating searching video clips into the reasoning process through reinforcement learning (RL). However, applying RL training methods, such as Group Relative Policy Optimization (GRPO), to video reasoning can result in unsupervised intermediate search decisions. This leads to insufficient exploration of the video content and inconsistent logical reasoning. To address these issues, we introduce GRPO with Completeness Self-Verification (GRPO-CSV), which gathers searched video frames from the interleaved reasoning process and utilizes the same policy model to verify the adequacy of searched frames, thereby improving the completeness of video reasoning. Additionally, we construct datasets specifically designed for the SFT cold-start and RL training of GRPO-CSV, filtering out samples with weak temporal dependencies to enhance task difficulty and improve temporal search capabilities. Extensive experiments demonstrate that TimeSearch-R achieves significant improvements on temporal search benchmarks such as Haystack-LVBench and Haystack-Ego4D, as well as long-form video understanding benchmarks like VideoMME and MLVU. Notably, TimeSearch-R establishes a new state-of-the-art on LongVideoBench with 4.1% improvement over the base model Qwen2.5-VL and 2.0% over the advanced video reasoning model Video-R1. Our code is available at https://github.com/Time-Search/TimeSearch-R.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 43 references that are in the map. First posted on arXiv 7 Nov 2025.
Builds on
32 of 43 references.
Closest ancestors · 7
Same direction, newest first
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025T*: Re-thinking Temporal Search for Long-Form Video Understanding3 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos29 May
Other references · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
13 more
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 323
- 2020Counterfactual VQA: A Cause-Effect Look at Language Biascited by 266
- 2024CinePile: A Long Video Question Answering Dataset and Benchmarkcited by 112
- 2024Frame-Voyager: Learning to Query Frames for Video Large Language Modelscited by 80
- 2024Too Many Frames, Not All Useful: Efficient Strategies for Long-Form Video QAcited by 68
- 2024KeyVideoLLM: Towards Large-scale Video Keyframe Selectioncited by 52
- 2025MDP3: A Training-free Approach for List-wise Frame Selection in Video-LLMscited by 40
- 2018Fair and Diverse DPP-based Data Summarizationcited by 39
- 2023Discovering Spatio-Temporal Rationales for Video Question Answeringcited by 21
- 2025Unleashing Hour-Scale Video Training for Long Video-Language Understandingcited by 21
- 2025ZoomV: Temporal Zoom-in for Efficient Long Video Understandingcited by 10
- 2025Iterative Zoom-In: Temporal Interval Exploration for Long Video Understandingcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 17.
18 papers.
Sort:
By area:
- 2025A Benchmark for Omni-Modal Reasoning in Long Videoscited by 5
- 2026EVA: Efficient Reinforcement Learning for End-to-End Video Agentcited by 5
- 2026Visual Agentic Memory: Enabling Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrievalcited by 2
- 2026EvoVid: Temporal-Centric Self-Evolution for Video Large Language Modelscited by 2
- 2026Reflect-R1: Evidence-Driven Reflection for Self-Correction in Long Video Understandingcited by 2
- 2026AdaptToken: Entropy-based Adaptive Token Selection for MLLM Long Video Understandingcited by 1
- 2026SEED: Targeted Data Selection by Weighted Independent Setcited by 1
- 2026Decomposing Queries into Tool Calls for Long-Video Keyframe Retrievalcited by 1
- 2026Incentivizing Vision Language Models to Search for Long Video Question Answeringcited by 1
- 2026OmniReasoner: Thinking with Long Audio-Video via Native Tool Usecited by 1
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligencecited by 0
- 2026VisReflect: Latent Visual Reflection for Fine-Grained Perception in Long Visual Contextcited by 0
6 more
- 2026QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understandingcited by 0
- 2026Searching Videos as Trees: Self-Correcting Agents for Grounded Long Video QAcited by 0
- 2026CADER: Confidence-Aware Dynamic Evidence Reasoning for Long-Video Understandingcited by 0
- 2026LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perceptioncited by 0
- 2026FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answeringcited by 0
- 2026VAMR: Multi-Question Agentic Reasoning for Efficient Long-Form Video Understandingcited by 0
- 2026VAMR: Multi-Question Agentic Reasoning for Efficient Long-Form Video Understanding8 Oct 2026
- 2026FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answering30 Sep 2026
- 2026LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perception30 Sep 2026
- 2026CADER: Confidence-Aware Dynamic Evidence Reasoning for Long-Video Understanding27 Jul 2026
- 2026OmniReasoner: Thinking with Long Audio-Video via Native Tool Use21 Jul 2026
- 2026Searching Videos as Trees: Self-Correcting Agents for Grounded Long Video QA17 Jul 2026
- 2026QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding6 Jul 2026
- 2026Incentivizing Vision Language Models to Search for Long Video Question Answering3 Jul 2026
- 2026VisReflect: Latent Visual Reflection for Fine-Grained Perception in Long Visual Context29 Jun 2026
- 2026Reflect-R1: Evidence-Driven Reflection for Self-Correction in Long Video Understanding26 Jun 2026
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence29 May 2026
- 2026Decomposing Queries into Tool Calls for Long-Video Keyframe Retrieval22 May 2026
6 more
- 2026EvoVid: Temporal-Centric Self-Evolution for Video Large Language Models21 May 2026
- 2026Visual Agentic Memory: Enabling Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrieval15 May 2026
- 2026SEED: Targeted Data Selection by Weighted Independent Set15 May 2026
- 2026AdaptToken: Entropy-based Adaptive Token Selection for MLLM Long Video Understanding30 Mar 2026
- 2026EVA: Efficient Reinforcement Learning for End-to-End Video Agent24 Mar 2026
- 2025A Benchmark for Omni-Modal Reasoning in Long Videos18 Dec 2025
- 2026EVA: Efficient Reinforcement Learning for End-to-End Video Agentcited by 5
- 2026AdaptToken: Entropy-based Adaptive Token Selection for MLLM Long Video Understandingcited by 1
- 2026Incentivizing Vision Language Models to Search for Long Video Question Answeringcited by 1
- 2026VisReflect: Latent Visual Reflection for Fine-Grained Perception in Long Visual Contextcited by 0
- 2026QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understandingcited by 0
- 2026FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answeringcited by 0
- 2026FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answering30 Sep 2026
- 2026QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding6 Jul 2026
- 2026Incentivizing Vision Language Models to Search for Long Video Question Answering3 Jul 2026
- 2026VisReflect: Latent Visual Reflection for Fine-Grained Perception in Long Visual Context29 Jun 2026
- 2026AdaptToken: Entropy-based Adaptive Token Selection for MLLM Long Video Understanding30 Mar 2026
- 2026EVA: Efficient Reinforcement Learning for End-to-End Video Agent24 Mar 2026
- 2026Visual Agentic Memory: Enabling Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrievalcited by 2
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligencecited by 0
- 2026Searching Videos as Trees: Self-Correcting Agents for Grounded Long Video QAcited by 0
- 2026Searching Videos as Trees: Self-Correcting Agents for Grounded Long Video QA17 Jul 2026
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence29 May 2026
- 2026Visual Agentic Memory: Enabling Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrieval15 May 2026
- 2026EvoVid: Temporal-Centric Self-Evolution for Video Large Language Modelscited by 2
- 2026Reflect-R1: Evidence-Driven Reflection for Self-Correction in Long Video Understandingcited by 2
- 2026SEED: Targeted Data Selection by Weighted Independent Setcited by 1
- 2026Decomposing Queries into Tool Calls for Long-Video Keyframe Retrievalcited by 1
- 2026LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perceptioncited by 0
- 2026VAMR: Multi-Question Agentic Reasoning for Efficient Long-Form Video Understandingcited by 0
- 2026VAMR: Multi-Question Agentic Reasoning for Efficient Long-Form Video Understanding8 Oct 2026
- 2026LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perception30 Sep 2026
- 2026Reflect-R1: Evidence-Driven Reflection for Self-Correction in Long Video Understanding26 Jun 2026
- 2026Decomposing Queries into Tool Calls for Long-Video Keyframe Retrieval22 May 2026
- 2026EvoVid: Temporal-Centric Self-Evolution for Video Large Language Models21 May 2026
- 2026SEED: Targeted Data Selection by Weighted Independent Set15 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026TimeThink: Reasoning with Time for Video LLMs
- 2025ChronoForge-RL: Chronological Forging through Reinforcement Learning for Enhanced Video Understanding
- 2025Tempo-R0: A Video-MLLM for Temporal Video Grounding through Efficient Temporal Sensing Reinforcement Learning
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning
- 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
- 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
- 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning