VAMR: Multi-Question Agentic Reasoning for Efficient Long-Form Video Understanding
On the map: LLM agents and tool use → Multimodal and embodied agents also fits: Agent memory systems
Abstract (arXiv)
Long-form video understanding often involves multiple questions about different aspects of the same recording. Yet existing video agents typically process each question through an isolated tool-use trajectory. This repeatedly restarts video exploration and memory construction, missing opportunities to acquire evidence jointly and progressively build a shared understanding that supports the complete question set. We introduce VAMR (Video Agent for Multi-Question Reasoning), which coordinates all questions about a video through one shared tool-use trajectory. At each round, a persistent policy model can invoke tools for one or more unresolved questions and submit answers for questions with sufficient evidence. Question-conditioned visual perception retrieves fine-grained clues for several questions in one call, while layered multi-question memory integrates reusable context into a shared video story and preserves separate evidence for individual questions. After supervised fine-tuning initializes this interaction protocol, we propose question-horizon policy optimization (qhpo) to optimize shared trajectories in which questions progress and finish at different rounds. Specifically, a question-level critic estimates the value of each active question, while round alignment maps each question advantage to the rounds that directly serve it before the aligned advantages are aggregated to optimize the shared actor. Across LVBench, Video-Holmes, and LongVideoBench, VAMR achieves the highest accuracy overall and the fewest reasoning rounds among iterative methods. On LVBench, it reaches 62.1% accuracy, exceeding VideoARM by 4.3 points while reducing reasoning rounds and processed frames by 85.9% and 61.4%.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 24 of its 49 references that are in the map. First posted on arXiv 8 Oct 2026.
Builds on
24 of 49 references.
Closest ancestors · 5
Same direction, newest first
- 2026ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning19 May
- 2026VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority12 May
- 2026LensWalk: Agentic Video Understanding by Planning How You See in Videos25 Mar
- 2025VideoARM: Agentic Reasoning over Hierarchical Memory for Long-Form Video Understanding13 Dec
- 2025UniVA: Universal Video Agent towards Open-Source Next-Generation Video Generalist11 Nov
Other references · 19
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
- 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 386
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 251
- 2024ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RLcited by 228
- 2025ToRL: Scaling Tool-Integrated RLcited by 169
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 118
- 2025Agent Lightning: Train ANY AI Agents with Reinforcement Learningcited by 109
- 2025StepSearch: Igniting LLMs Search Ability via Step-Wise Proximal Policy Optimizationcited by 88
- 2025Reinforcing Multi-Turn Reasoning in LLM Agents via Fine-Grained Reward Structure and Credit Assignmentcited by 79
7 more
- 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlightingcited by 42
- 2025LOVE-R1: Advancing Long Video Understanding with an Adaptive Zoom-in Mechanism via Multi-Step Reasoningcited by 27
- 2026Video-o3: Native Interleaved Clue Seeking for Long Video Multi-Hop Reasoningcited by 24
- 2025MR. Video: "MapReduce" is the Principle for Long Video Understandingcited by 23
- 2025TimeSearch-R: Adaptive Temporal Search for Long-Form Video Understanding via Self-Verification Reinforcement Learningcited by 20
- 2024Advancing Content Moderation: Evaluating Large Language Models for Detecting Sensitive Content Across Text, Images, and Videoscited by 10
- 2025Beyond Isolated Facts: Synthesizing Narrative and Grounded Supervision for VideoQAcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Sprout: Building Dynamic Memory While Reasoning for Agentic Video Understanding
- 2026Think, Then Verify: A Hypothesis-Verification Multi-Agent Framework for Long Video Understanding
- 2026HiCrew: Hierarchical Reasoning for Long-Form Video Understanding via Question-Aware Multi-Agent Collaboration
- 2026VideoJev: System One Model for Video Understanding and Interaction
- 2026Incentivizing Vision Language Models to Search for Long Video Question Answering
- 2026A Skill-augmented Agentic Framework and Benchmark for Multi-Video Understanding
- 2026AgentVidBench: A Multi-Hop Video Question Answering Benchmark for Evaluating MLLM Agents
- 2025AVATAAR: Agentic Video Answering via Temporal Adaptive Alignment and Reasoning