mlsanityData to 14 Oct 2026

Open-o3-Video-v2: Seek, Ground, and Reason with Verifiable Spatio-Temporal Evidence

arXiv 2610.17656 ↗First posted 13 Oct 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning also fits: Spatial and embodied reasoning

Abstract (arXiv)

Reliable video reasoning requires models to produce correct answers and expose supporting visual evidence. Open-o3-Video enables verifiable reasoning by embedding timestamps and object-level bounding boxes into reasoning traces, but is restricted to frames from an initial sparse sampler. We introduce Open-o3-Video-v2, which formulates video reasoning as a unified agentic evidencegrounded process. The model identifies missing information, acquires additional observations, grounds the moments and objects supporting its reasoning, and writes this evidence into the trajectory before continuing or answering. To support this behavior, we construct STGR-v2-CoT135K, including 52K multi-turn agentic grounded reasoning trajectories, and STGR-v2-RL-13K for reinforcement learning. We further propose Clue-Seek GRPO (CS-GRPO), which tracks how tool calls change accumulated evidence, rewards clue coverage and step-wise gains, and penalizes excessive, repetitive, or uninformative retrieval. On V-STaR, Open-o3-Video-v2-4B achieves 40.4% mAM and 56.3% mLGM, outperforming its Qwen3-VL-4B backbone by 8.5% and 12.6%, respectively. It also delivers consistent gains across general video understanding, long-video reasoning, and temporal grounding benchmarks. These results show that active evidence acquisition and verifiable object-level grounding are complementary for reliable video reasoning. The code and models are released at https://msalab-pku.github.io/projects/Open-o3-Video-v2.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 68 of its 75 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

68 of 75 references.

Closest ancestors · 30

Same direction, newest first

  1. 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun
  2. 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoning30 Jan
  3. 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoning26 Dec
  4. 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs16 Dec
  5. 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models28 Nov
  6. 2025Thinking With Bounding Boxes: Enhancing Spatio-Temporal Video Grounding via Reinforcement Fine-Tuning26 Nov
  7. 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling25 Nov
  8. 2025Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learning27 Oct
  9. 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidence23 Oct
  10. 2025Conan: Progressive Learning to Reason Like a Detective over Multi-Scale Visual Evidence23 Oct
  11. 2025VTimeCoT: Thinking by Drawing for Video Temporal Grounding and Reasoning16 Oct
  12. 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesis28 Sep
18 more
  1. 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perception25 Sep
  2. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning6 Aug
  3. 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning9 Jul
  4. 2025Video-CoT: A Comprehensive Dataset for Spatiotemporal Understanding of Videos Based on Chain-of-Thought10 Jun
  5. 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoning31 May
  6. 2025Reinforcing Video Reasoning with Focused Thinking30 May
  7. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
  8. 2025VerIPO: Cultivating Long Reasoning in Video-LLMs via Verifier-Gudied Iterative Policy Optimization25 May
  9. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
  10. 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
  11. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  12. 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoning14 Mar
  13. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  14. 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection22 Nov
  15. 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos29 May
  16. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition7 May
  17. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
  18. 2023Look, Remember and Reason: Grounded reasoning in videos with language models30 Jun

Other references · 38

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  5. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  6. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  7. 2025SAM 3: Segment Anything with Conceptscited by 906
  8. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  9. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  10. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
  11. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 406
  12. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
26 more
  1. 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 229
  2. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 159
  3. 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 155
  4. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
  5. 2024LITA: Language Instructed Temporal-Localization Assistantcited by 125
  6. 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 91
  7. 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 89
  8. 2024CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understandingcited by 85
  9. 2025VideoRAG: Retrieval-Augmented Generation with Extreme Long-Context Videoscited by 77
  10. 2024VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLMcited by 72
  11. 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 69
  12. 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 61
  13. 2025LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understandingcited by 59
  14. 2024DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models (Exemplified as A Video Agent)cited by 58
  15. 2022Embracing Consistency: A One-Stage Approach for Spatio-Temporal Video Groundingcited by 42
  16. 2026LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligencecited by 39
  17. 2025VideoAgent2: Enhancing the LLM-Based Agent System for Long-Form Video Understanding by Uncertainty-Aware CoTcited by 38
  18. 2025Universal Video Temporal Grounding with Generative Multi-modal Large Language Modelscited by 27
  19. 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learningcited by 21
  20. 2025Datasets and Recipes for Video Temporal Grounding via Reinforcement Learningcited by 19
  21. 2025VistaDPO: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Modelscited by 17
  22. 2026CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioningcited by 8
  23. 2026OmniVideo-100K: A Dataset for Audio-Visual Reasoning through Structured Scripts and Evidence Chainscited by 8
  24. 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videoscited by 7
  25. 2026Towards One-to-Many Temporal Groundingcited by 4
  26. 2026VideoSeeker: Incentivizing Instance-level Video Understanding via Native Agentic Tool Invocationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning
  2. 2026Thinking Beyond Videos: Unifying Video Reasoning and Deep Research for Open-World Video Agents
  3. 2026TimeThink: Reasoning with Time for Video LLMs
  4. 2026SER: Learning to Ground Video Reasoning with Semantic Evidence Rewards
  5. 2025Know-Show: Benchmarking Video-Language Models on Spatio-Temporal Grounded Reasoning
  6. 2026VideoSeek: Long-Horizon Video Agent with Tool-Guided Seeking
  7. 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding
  8. 2026VLX-VR: An Agentic-Aware Video Reasoning Model