mlsanityData to 7 Oct 2026

Thinking Beyond Videos: Unifying Video Reasoning and Deep Research for Open-World Video Agents

arXiv 2608.23329 ↗First posted 24 Aug 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-world video understanding often requires a model to locate sparse visual evidence and acquire external knowledge that is absent from the video and its parametric memory. While Thinking-with-Videos enables active temporal perception and Deep Research supports multi-step information seeking, the two capabilities are typically developed in isolation. We introduce VideoRover, a unified Video Deep Research framework that iteratively coordinates video cropping, multimodal search, and webpage browsing. Given a video-question pair, VideoRover uses each tool result to select the next action, so localized video clips guide external retrieval and retrieved evidence triggers further video inspection and verification. To develop this capability, we construct an automated data curation pipeline, producing 26K verified SFT trajectories and 3K challenging RL instances. We also introduce VideoRover-Bench, a benchmark stratified by video duration and research difficulty. Experiments on VideoDR and VideoRover-Bench show that our VideoRover-8B-RL achieves performance comparable to proprietary models in the direct-answer setting without tool use while outperforming larger open-source models equipped with the same tool suite. Ablation studies and training dynamics further validate the complementary roles of active video grounding, external retrieval, and long-horizon reinforcement learning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 42 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

40 of 42 references.

References · 40

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2025Qwen3-VL Technical Reportcited by 2,534
  5. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  6. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  7. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  8. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  9. 2025OpenAI GPT-5 System Cardcited by 910
  10. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  11. 2025Group Sequence Policy Optimizationcited by 788
  12. 2024Long Context Transfer from Language to Visioncited by 502
28 more
  1. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
  2. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
  3. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 320
  4. 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
  5. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268
  6. 2022MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Textcited by 216
  7. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learningcited by 163
  8. 2025Thyme: Think Beyond Imagescited by 160
  9. 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 120
  10. 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 114
  11. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 88
  12. 2024Searching for Best Practices in Retrieval-Augmented Generationcited by 83
  13. 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 58
  14. 2025A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applicationscited by 48
  15. 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generationcited by 42
  16. 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlightingcited by 39
  17. 2026Vision-DeepResearch: Incentivizing DeepResearch Capability in Multimodal Large Language Modelscited by 33
  18. 2025Deep Research: A Systematic Surveycited by 23
  19. 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoningcited by 20
  20. 2026MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baselinecited by 18
  21. 2026OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agentscited by 18
  22. 2026Watching, Reasoning, and Searching: A Video Deep Research Benchmark on Open Web for Agentic Video Reasoningcited by 14
  23. 2025Video-Browser: Towards Agentic Open-web Video Browsingcited by 9
  24. 2026HyperEyes: Dual-Grained Efficiency-Aware Reinforcement Learning for Parallel Multimodal Search Agentscited by 8
  25. 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videoscited by 6
  26. 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 3
  27. 2026LookWise: Knowing When and Where to Look for Fine-Grained Visual Reasoning in Multimodal Large Language Modelscited by 2
  28. 2026DynFrame: Adaptive Reasoning-Driven Multimodal Framework with Dynamic Frame Augmentation for Complex Video Understandingcited by 1

Built on by

Not cited yet.