mlsanityData to 7 Oct 2026

TimeSearch-R: Adaptive Temporal Search for Long-Form Video Understanding via Self-Verification Reinforcement Learning

arXiv 2511.05489 ↗First posted 7 Nov 2025cs.CV cs.AIcited by 18

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Temporal search aims to identify a minimal set of relevant frames from tens of thousands based on a given query, serving as a foundation for accurate long-form video understanding. Existing works attempt to progressively narrow the search space. However, these approaches typically rely on a hand-crafted search process, lacking end-to-end optimization for learning optimal search strategies. In this paper, we propose TimeSearch-R, which reformulates temporal search as interleaved text-video thinking, seamlessly integrating searching video clips into the reasoning process through reinforcement learning (RL). However, applying RL training methods, such as Group Relative Policy Optimization (GRPO), to video reasoning can result in unsupervised intermediate search decisions. This leads to insufficient exploration of the video content and inconsistent logical reasoning. To address these issues, we introduce GRPO with Completeness Self-Verification (GRPO-CSV), which gathers searched video frames from the interleaved reasoning process and utilizes the same policy model to verify the adequacy of searched frames, thereby improving the completeness of video reasoning. Additionally, we construct datasets specifically designed for the SFT cold-start and RL training of GRPO-CSV, filtering out samples with weak temporal dependencies to enhance task difficulty and improve temporal search capabilities. Extensive experiments demonstrate that TimeSearch-R achieves significant improvements on temporal search benchmarks such as Haystack-LVBench and Haystack-Ego4D, as well as long-form video understanding benchmarks like VideoMME and MLVU. Notably, TimeSearch-R establishes a new state-of-the-art on LongVideoBench with 4.1% improvement over the base model Qwen2.5-VL and 2.0% over the advanced video reasoning model Video-R1. Our code is available at https://github.com/Time-Search/TimeSearch-R.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 43 references that are in the map. First posted on arXiv 7 Nov 2025.

Builds on

32 of 43 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
  2. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  3. 2025T*: Re-thinking Temporal Search for Long-Form Video Understanding3 Apr
  4. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  5. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
  6. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
  7. 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos29 May

Other references · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  8. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  9. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  10. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  11. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  12. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
13 more
  1. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
  2. 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 323
  3. 2020Counterfactual VQA: A Cause-Effect Look at Language Biascited by 266
  4. 2024CinePile: A Long Video Question Answering Dataset and Benchmarkcited by 112
  5. 2024Frame-Voyager: Learning to Query Frames for Video Large Language Modelscited by 80
  6. 2024Too Many Frames, Not All Useful: Efficient Strategies for Long-Form Video QAcited by 68
  7. 2024KeyVideoLLM: Towards Large-scale Video Keyframe Selectioncited by 52
  8. 2025MDP3: A Training-free Approach for List-wise Frame Selection in Video-LLMscited by 40
  9. 2018Fair and Diverse DPP-based Data Summarizationcited by 39
  10. 2023Discovering Spatio-Temporal Rationales for Video Question Answeringcited by 21
  11. 2025Unleashing Hour-Scale Video Training for Long Video-Language Understandingcited by 21
  12. 2025ZoomV: Temporal Zoom-in for Efficient Long Video Understandingcited by 10
  13. 2025Iterative Zoom-In: Temporal Interval Exploration for Long Video Understandingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 17.

18 papers.

Sort:

By area:

  1. 2025A Benchmark for Omni-Modal Reasoning in Long Videoscited by 5
  2. 2026EVA: Efficient Reinforcement Learning for End-to-End Video Agentcited by 5
  3. 2026Visual Agentic Memory: Enabling Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrievalcited by 2
  4. 2026EvoVid: Temporal-Centric Self-Evolution for Video Large Language Modelscited by 2
  5. 2026Reflect-R1: Evidence-Driven Reflection for Self-Correction in Long Video Understandingcited by 2
  6. 2026AdaptToken: Entropy-based Adaptive Token Selection for MLLM Long Video Understandingcited by 1
  7. 2026SEED: Targeted Data Selection by Weighted Independent Setcited by 1
  8. 2026Decomposing Queries into Tool Calls for Long-Video Keyframe Retrievalcited by 1
  9. 2026Incentivizing Vision Language Models to Search for Long Video Question Answeringcited by 1
  10. 2026OmniReasoner: Thinking with Long Audio-Video via Native Tool Usecited by 1
  11. 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligencecited by 0
  12. 2026VisReflect: Latent Visual Reflection for Fine-Grained Perception in Long Visual Contextcited by 0
6 more
  1. 2026QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understandingcited by 0
  2. 2026Searching Videos as Trees: Self-Correcting Agents for Grounded Long Video QAcited by 0
  3. 2026CADER: Confidence-Aware Dynamic Evidence Reasoning for Long-Video Understandingcited by 0
  4. 2026LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perceptioncited by 0
  5. 2026FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answeringcited by 0
  6. 2026VAMR: Multi-Question Agentic Reasoning for Efficient Long-Form Video Understandingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026TimeThink: Reasoning with Time for Video LLMs
  2. 2025ChronoForge-RL: Chronological Forging through Reinforcement Learning for Enhanced Video Understanding
  3. 2025Tempo-R0: A Video-MLLM for Temporal Video Grounding through Efficient Temporal Sensing Reinforcement Learning
  4. 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
  5. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning
  6. 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
  7. 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
  8. 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning