mlsanityData to 13 Oct 2026

SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning

arXiv 2608.07959 ↗First posted 8 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Ultra-long egocentric video understanding requires reasoning over temporally sparse evidence distributed across hours or days, challenging current multimodal models with limited context and the grounding of key video segments. While Chain-of-Tool-Thought (CoTT) agent systems enable iterative retrieval and inspection, they suffer from error propagation due to rigid zoom-in strategies that lack recovery mechanisms. In this work, we address these challenges through SCOUT (Self-Checking Chain-Of-Tool-thought), a recovery-aware agentic framework introducing an adaptive policy that evaluates intermediate tool observations and dynamically trades off exploitation (zoom-in) and exploration (region switching), enabling robust multi-hop reasoning over extremely long horizons. However, training such multi-turn tool-using agents remains challenging, as existing RL methods rely on sparse outcome-level rewards and lack supervision over extended decision trajectories, resulting in suboptimal credit assignment for long-horizon reasoning. To address this, we develop UPS-GRPO, an uncertainty-prioritized policy optimization method that concentrates exploration on high-uncertainty post-tool states while preserving sample efficiency. We further introduce a turn-level advantage decomposition that integrates outcome rewards with tool-grounded temporal alignment rewards for improved credit assignment. Experiments show that SCOUT achieves state-of-the-art results on ultra-long egocentric benchmarks, while remaining competitive on shorter-horizon long-video settings.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 38 of its 55 references that are in the map. First posted on arXiv 8 Aug 2026.

Builds on

38 of 55 references.

References · 38

  1. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,714
  2. 2023Let's Verify Step by Stepcited by 3,672
  3. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,197
  4. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,003
  5. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 653
  6. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 567
  7. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 466
  8. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 347
  9. 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 327
  10. 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 211
  11. 2024HourVideo: 1-Hour Video-Language Understandingcited by 113
  12. 2025VerlTool: Towards Holistic Agentic Reinforcement Learning with Tool Usecited by 95
26 more
  1. 2025Reinforcing Multi-Turn Reasoning in LLM Agents via Fine-Grained Reward Structure and Credit Assignmentcited by 78
  2. 2025SPA-RL: Reinforcing LLM Agents via Stepwise Progress Attributioncited by 69
  3. 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 67
  4. 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Callingcited by 59
  5. 2024Grounded Multi-Hop VideoQA in Long-Form Egocentric Videoscited by 44
  6. 2024Getting More Juice Out of the SFT Data: Reward Learning from Human Demonstration Improves SFT for LLM Alignmentcited by 32
  7. 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Datasetcited by 29
  8. 2025TSPO: Temporal Sampling Policy Optimization for Long-form Video Language Understandingcited by 24
  9. 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoningcited by 24
  10. 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesiscited by 22
  11. 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoningcited by 21
  12. 2026VideoSeek: Long-Horizon Video Agent with Tool-Guided Seekingcited by 17
  13. 2026OASIS: On-Demand Hierarchical Event Memory for Streaming Video Reasoningcited by 17
  14. 2025Tool-R1: Sample-Efficient Reinforcement Learning for Agentic Tool Usecited by 16
  15. 2025X-LeBench: A Benchmark for Extremely Long Egocentric Video Understandingcited by 15
  16. 2026RC-GRPO: Reward-Conditioned Group Relative Policy Optimization for Multi-Turn Tool Calling Agentscited by 11
  17. 2026EventMemAgent: Hierarchical Event-Centric Memory for Online Video Understanding with Adaptive Tool Usecited by 10
  18. 2026VideoThinker: Building Agentic VideoLLMs with LLM-Guided Tool Reasoningcited by 9
  19. 2025PSGait: Gait Recognition using Parsing Skeletoncited by 8
  20. 2025DAGait: Generalized Skeleton-Guided Data Alignment for Gait Recognitioncited by 8
  21. 2026Step Potential Advantage Estimation: Harnessing Intermediate Confidence and Correctness for Efficient Mathematical Reasoningcited by 8
  22. 2026Think, Then Verify: A Hypothesis-Verification Multi-Agent Framework for Long Video Understandingcited by 8
  23. 2026Language-Guided and Motion-Aware Gait Representation for Generalizable Recognitioncited by 6
  24. 2026Collaborative Multi-Agent Scripts Generation for Enhancing Imperfect-Information Reasoning in Murder Mystery Gamescited by 6
  25. 2025CAViAR: Critic-Augmented Video Agentic Reasoningcited by 5
  26. 2025Free-MoRef: Instantly Multiplexing Context Perception Capabilities of Video-MLLMs within Single Inferencecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understanding
  2. 2025Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding
  3. 2025VideoAgent2: Enhancing the LLM-Based Agent System for Long-Form Video Understanding by Uncertainty-Aware CoT
  4. 2026Agentic Very Long Video Understanding
  5. 2026VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding
  6. 2025EgoVITA: Learning to Plan and Verify for Egocentric Video Reasoning
  7. 2026MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Hierarchical Graph Memory and Agentic Retrieval Mechanism
  8. 2026VLX-VR: An Agentic-Aware Video Reasoning Model