MUPA: Towards Multi-Path Agentic Reasoning for Grounded Video Question Answering
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Grounded Video Question Answering (Grounded VideoQA) requires aligning textual answers with explicit visual evidence. However, modern multimodal models often rely on linguistic priors and spurious correlations, resulting in poorly grounded predictions. In this work, we propose MUPA, a cooperative MUlti-Path Agentic approach that unifies video grounding, question answering, answer reflection and aggregation to tackle Grounded VideoQA. MUPA features three distinct reasoning paths on the interplay of grounding and QA agents in different chronological orders, along with a dedicated reflection agent to judge and aggregate the multi-path results to accomplish consistent QA and grounding. This design markedly improves grounding fidelity without sacrificing answer accuracy. Despite using only 2B parameters, our method outperforms all 7B-scale competitors. When scaled to 7B parameters, MUPA establishes new state-of-the-art results, with Acc@GQA of 30.3% and 47.4% on NExT-GQA and DeVE-QA respectively, demonstrating MUPA' effectiveness towards trustworthy video-language understanding. Our code is available in https://github.com/longmalongma/MUPA.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 58 of its 65 references that are in the map. First posted on arXiv 22 Jun 2025.
Builds on
58 of 65 references.
Closest ancestors · 2
Same direction, newest first
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding18 Mar
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agent15 Mar
Other references · 56
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2024GPT-4o System Cardcited by 4,588
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
- 2023VideoChat: Chat-Centric Video Understandingcited by 857
- 2017Dense-Captioning Events in Videoscited by 793
38 more
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
- 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
- 2018TVQA: Localized, Compositional Video Question Answeringcited by 467
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 406
- 2017TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answeringcited by 378
- 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 285
- 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 255
- 2020Span-based Localizing Network for Natural Language Video Localizationcited by 235
- 2023Valley: Video Assistant with Large Language model Enhanced abilitYcited by 234
- 2022Zero-Shot Video Question Answering via Frozen Bidirectional Language Modelscited by 229
- 2020TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrievalcited by 215
- 2023Self-Chained Image-Language Model for Video Localization and Question Answeringcited by 203
- 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 190
- 2023A Simple LLM Framework for Long-Range Video Question-Answeringcited by 178
- 2024Streaming Long Video Understanding with Large Language Modelscited by 167
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
- 2022UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detectioncited by 148
- 2023Can I Trust Your Answer? Visually Grounded Video Question Answeringcited by 135
- 2022Revealing Single Frame Bias for Video-and-Language Learningcited by 133
- 2024LITA: Language Instructed Temporal-Localization Assistantcited by 125
- 2024Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoningcited by 122
- 2024CinePile: A Long Video Question Answering Dataset and Benchmarkcited by 114
- 2024Improving Multi-Agent Debate with Sparse Communication Topologycited by 107
- 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 91
- 2021Negative Sample Matters: A Renaissance of Metric Learning for Temporal Groundingcited by 90
- 2024HawkEye: Training Video-Text LLMs for Grounding Text in Videoscited by 86
- 2023Hierarchical Video-Moment Retrieval and Step-Captioningcited by 83
- 2022An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modelingcited by 74
- 2024MoReVQA: Exploring Modular Reasoning Models for Video Question Answeringcited by 74
- 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queriescited by 72
- 2024E.T. Bench: Towards Open-Ended Event-Level Video-Language Understandingcited by 70
- 2023MomentDiff: Generative Video Moment Retrieval from Random to Realcited by 58
- 2024Language Repository for Long Video Understandingcited by 55
- 2024ChatVTG: Video Temporal Grounding via Chat with Video Dialogue Large Language Modelscited by 54
- 2024ReXTime: A Benchmark Suite for Reasoning-Across-Time in Videoscited by 51
- 2024R2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Groundingcited by 34
- 2023Towards Generalisable Video Moment Retrieval: Visual-Dynamic Injection to Image-Text Pre-Trainingcited by 32
- 2024VideoQA in the Era of LLMs: An Empirical Studycited by 29
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learningcited by 6
- 2025Decoupled Seg Tokens Make Stronger Reasoning Video Segmenter and Groundercited by 2
- 2025Empowering Multimodal LLMs with External Tools: A Comprehensive Surveycited by 2
- 2026AgentVidBench: A Multi-Hop Video Question Answering Benchmark for Evaluating MLLM Agentscited by 0
- 2026AgentVidBench: A Multi-Hop Video Question Answering Benchmark for Evaluating MLLM Agents18 Sep 2026
- 2025SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learning15 Dec 2025
- 2025Empowering Multimodal LLMs with External Tools: A Comprehensive Survey14 Aug 2025
- 2025Decoupled Seg Tokens Make Stronger Reasoning Video Segmenter and Grounder28 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025ViQAgent: Zero-Shot Video Question Answering via Agent with Open-Vocabulary Grounding Validation
- 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoning
- 2025VideoMultiAgents: A Multi-Agent Framework for Video Question Answering
- 2025Pinpointing Trigger Moment for Grounded Video QA: Enhancing Spatio-temporal Grounding in Multimodal Large Language Models
- 2025LeAdQA: LLM-Driven Context-Aware Temporal Grounding for Video Question Answering
- 2026Searching Videos as Trees: Self-Correcting Agents for Grounded Long Video QA
- 2026VTAgent: Agentic Keyframe Anchoring for Evidence-Aware Video TextVQA
- 2026VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority