mlsanityData to 14 Oct 2026

UpstreamQA: A Modular Framework for Explicit Reasoning on Video Question Answering Tasks

arXiv 2604.23145 ↗First posted 25 Apr 2026cs.CV cs.AIcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Video Question Answering (VideoQA) demands models that jointly reason over spatial, temporal, and linguistic cues. However, the task's inherent complexity often requires multi-step reasoning that current large multimodal models (LMMs) perform implicitly, leaving their internal decision process opaque. In contrast, large reasoning models (LRMs) explicitly generate intermediate logical steps that enhance interpretability and can improve multi-hop reasoning accuracy. Yet, these models are not designed for native video understanding, as they typically rely on static frame sampling. We propose UpstreamQA, a modular framework that disentangles and evaluates core video reasoning components through explicit upstream reasoning modules. Specifically, we employ multimodal LRMs to perform object identification and scene context generation before passing enriched reasoning traces to downstream LMMs for VideoQA. We evaluate UpstreamQA on the OpenEQA and NExTQA datasets using two LRMs (o4-mini, Gemini 2.5 Pro) and two LMMs (GPT-4o, Gemini 2.5 Flash). Our results demonstrate that introducing explicit reasoning can significantly boost performance and interpretability of downstream VideoQA, but can also lead to performance degradation when baseline performance is sufficiently high. Overall, UpstreamQA offers a principled framework for combining explicit reasoning and multimodal understanding, advancing both performance and diagnostic transparency in VideoQA in several scenarios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 33 references that are in the map. First posted on arXiv 25 Apr 2026.

Builds on

19 of 33 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025ReasVQA: Advancing VideoQA with Imperfect Reasoning Process23 Jan
  2. 2024MoReVQA: Exploring Modular Reasoning Models for Video Question Answering9 Apr

Other references · 17

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  5. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  6. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  7. 2017Embodied Question Answeringcited by 336
  8. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
  9. 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 293
  10. 2023A Simple LLM Framework for Long-Range Video Question-Answeringcited by 178
  11. 2025VideoRAG: Retrieval-Augmented Generation with Extreme Long-Context Videoscited by 77
  12. 2025VideoRAG: Retrieval-Augmented Generation over Video Corpuscited by 57
5 more
  1. 2024VideoQA in the Era of LLMs: An Empirical Studycited by 29
  2. 2024TraveLER: A Modular Multi-LMM Agent Framework for Video Question-Answeringcited by 25
  3. 2024Enhanced Multimodal RAG-LLM for Accurate Visual Question Answeringcited by 10
  4. 2025ENTER: Event Based Interpretable Reasoning for VideoQAcited by 5
  5. 2025LeAdQA: LLM-Driven Context-Aware Temporal Grounding for Video Question Answeringcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Team of One: Cracking Complex Video QA with Model Synergy
  2. 2025Looking Beyond Visible Cues: Implicit Video Question Answering via Dual-Clue Reasoning
  3. 2025Tool-Augmented Spatiotemporal Reasoning for Streamlining Video Question Answering Task
  4. 2024Prompting Video-Language Foundation Models with Domain-specific Fine-grained Heuristics for Video Question Answering
  5. 2025StreamingCoT: A Dataset for Temporal Dynamics and Multimodal Chain-of-Thought Reasoning in Streaming VideoQA
  6. 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  7. 2025Foundational Question Generation for Video Question Answering via an Embedding-Integrated Approach
  8. 2026Enhancing Localized Reasoning for Long Video Understanding via Efficient Segment-to-Video Supervision