mlsanityData to 14 Oct 2026

Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoning

arXiv 2601.23224 ↗First posted 30 Jan 2026cs.CVcited by 24

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Existing multimodal large language models for long-video understanding predominantly rely on uniform sampling and single-turn inference, limiting their ability to identify sparse yet critical evidence amid extensive redundancy. We introduce Video-o3, a novel framework that supports iterative discovery of salient visual clues, fine-grained inspection of key segments, and adaptive termination once sufficient evidence is acquired. Technically, we address two core challenges in interleaved tool invocation. First, to mitigate attention dispersion induced by the heterogeneity of reasoning and tool-calling, we propose Task-Decoupled Attention Masking, which isolates per-step concentration while preserving shared global context. Second, to control context length growth in multi-turn interactions, we introduce a Verifiable Trajectory-Guided Reward that balances exploration coverage with reasoning efficiency. To support training at scale, we further develop a data synthesis pipeline and construct Seeker-173K, comprising 173K high-quality tool-interaction trajectories for effective supervised and reinforcement learning. Extensive experiments show that Video-o3 substantially outperforms state-of-the-art methods, achieving 72.1% accuracy on MLVU and 46.5% on Video-Holmes. These results demonstrate Video-o3's strong multi-hop evidence-seeking and reasoning capabilities, and validate the effectiveness of native tool invocation in long-video scenarios.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 38 of its 62 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

38 of 62 references.

Closest ancestors · 22

Same direction, newest first

  1. 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoning26 Dec
  2. 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs16 Dec
  3. 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling25 Nov
  4. 2025REVISOR: Beyond Textual Reflection, Towards Multimodal Introspective Reasoning in Long-Form Video Understanding17 Nov
  5. 2025Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learning27 Oct
  6. 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidence23 Oct
  7. 2025Conan: Progressive Learning to Reason Like a Detective over Multi-Scale Visual Evidence23 Oct
  8. 2025LOVE-R1: Advancing Long Video Understanding with an Adaptive Zoom-in Mechanism via Multi-Step Reasoning29 Sep
  9. 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesis28 Sep
  10. 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perception25 Sep
  11. 2025Video-MTR: Reinforced Multi-Turn Reasoning for Long Video Understanding28 Aug
  12. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning6 Aug
10 more
  1. 2025Scaling RL to Long Videos10 Jul
  2. 2025VideoChat-A1: Thinking with Long Videos by Chain-of-Shot Reasoning6 Jun
  3. 2025MMR-V: What's Left Unsaid? A Benchmark for Multimodal Deep Reasoning in Videos4 Jun
  4. 2025VideoReasonBench: Can MLLMs Perform Vision-Centric Complex Video Reasoning?29 May
  5. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
  6. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  7. 2025Visual Agentic Reinforcement Fine-Tuning20 May
  8. 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
  9. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  10. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar

Other references · 16

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  6. 2017Decoupled Weight Decay Regularizationcited by 1,831
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  8. 2024OpenAI o1 System Cardcited by 1,244
  9. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  10. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
  11. 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 211
  12. 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
4 more
  1. 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 120
  2. 2024CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understandingcited by 85
  3. 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 81
  4. 2025Tongyi DeepResearch Technical Reportcited by 66

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 24.

24 papers.

Sort:

By area:

  1. 2026Video Streaming Thinking: VideoLLMs Can Watch and Think Simultaneouslycited by 22
  2. 2026VISD: Enhancing Video Reasoning via Structured Self-Distillationcited by 10
  3. 2026VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understandingcited by 10
  4. 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verificationcited by 7
  5. 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learningcited by 6
  6. 2026VisionCoach: Reinforcing Grounded Video Reasoning via Visual-Perception Promptingcited by 4
  7. 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 4
  8. 2026Annotations as Rollouts: Efficient and Scalable Reinforcement Learning for Video MLLMscited by 4
  9. 2026UniHM: Unified Dexterous Hand Manipulation with Vision Language Modelcited by 3
  10. 2026Query-Conditioned Evidential Keyframe Sampling for MLLM-Based Long-Form Video Understandingcited by 3
  11. 2026Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Predictioncited by 3
  12. 2026TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMscited by 3
12 more
  1. 2026DynFrame: Adaptive Reasoning-Driven Multimodal Framework with Dynamic Frame Augmentation for Complex Video Understandingcited by 1
  2. 2026Thinking with Cameras: Active Visual Reasoning via Dynamic Viewpoint Control for Surveillance Video Understandingcited by 1
  3. 2026OneStreamer: Unifying Perception, Memory, and Proactive Response in Streaming Video Interactioncited by 1
  4. 2026Searching Videos as Trees: Self-Correcting Agents for Grounded Long Video QAcited by 0
  5. 2026SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoningcited by 0
  6. 2026Thinking Beyond Videos: Unifying Video Reasoning and Deep Research for Open-World Video Agentscited by 0
  7. 2026Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Modelscited by 0
  8. 2026Beyond Entropy: Self-Diagnostic Multi-Role Token Optimization for Video Reasoningcited by 0
  9. 2026VAMR: Multi-Question Agentic Reasoning for Efficient Long-Form Video Understandingcited by 0
  10. 2026Open-o3-Video-v2: Seek, Ground, and Reason with Verifiable Spatio-Temporal Evidencecited by 0
  11. 2026VideoJev: System One Model for Video Understanding and Interactioncited by 0
  12. 2026OmniCompass: A Holistic Benchmark for Omni-Modal Video Grounding and Understandingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning
  2. 2026VideoDetective: Clue Hunting via both Extrinsic Query and Intrinsic Relevance for Long Video Understanding
  3. 2026VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding
  4. 2026TimeThink: Reasoning with Time for Video LLMs
  5. 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting
  6. 2026TIR-Flow: Active Video Search and Reasoning with Frozen VLMs
  7. 2026Clue Matters: Leveraging Latent Visual Clues to Empower Video Reasoning
  8. 2026LongVideo-R1: Smart Navigation for Low-cost Long Video Understanding