Video-QTR: Query-Driven Temporal Reasoning Framework for Lightweight Video Understanding
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
The rapid development of multimodal large-language models (MLLMs) has significantly expanded the scope of visual language reasoning, enabling unified systems to interpret and describe complex visual content. However, applying these models to long-video understanding remains computationally intensive. Dense frame encoding generates excessive visual tokens, leading to high memory consumption, redundant computation, and limited scalability in real-world applications. This inefficiency highlights a key limitation of the traditional process-then-reason paradigm, which analyzes visual streams exhaustively before semantic reasoning. To address this challenge, we introduce Video-QTR (Query-Driven Temporal Reasoning), a lightweight framework that redefines video comprehension as a query-guided reasoning process. Instead of encoding every frame, Video-QTR dynamically allocates perceptual resources based on the semantic intent of the query, creating an adaptive feedback loop between reasoning and perception. Extensive experiments across five benchmarks: MSVD-QA, Activity Net-QA, Movie Chat, and Video MME demonstrate that Video-QTR achieves state-of-the-art performance while reducing input frame consumption by up to 73%. These results confirm that query-driven temporal reasoning provides an efficient and scalable solution for video understanding.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 46 references that are in the map. First posted on arXiv 10 Dec 2025.
Builds on
40 of 46 references.
Closest ancestors · 3
Same direction, newest first
- 2024An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLM27 Mar
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
- 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language1 Apr
Other references · 37
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Visual Instruction Tuningcited by 7,792
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
25 more
- 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,038
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
- 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 539
- 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
- 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 368
- 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 320
- 2023Valley: Video Assistant with Large Language model Enhanced abilitYcited by 231
- 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understandingcited by 223
- 2022MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognitioncited by 189
- 2024VITA: Towards Open-Source Interactive Omni Multimodal LLMcited by 172
- 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 160
- 2023mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Videocited by 154
- 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 153
- 2021Towards Long-Form Video Understandingcited by 146
- 2024LongVLM: Efficient Long Video Understanding via Large Language Modelscited by 146
- 2024ST-LLM: Large Language Models Are Effective Temporal Learnerscited by 126
- 2023Selective Structured State-Spaces for Long-Form Video Understandingcited by 105
- 2024MovieChat+: Question-aware Sparse Memory for Long Video Question Answeringcited by 73
- 2024Too Many Frames, Not All Useful: Efficient Strategies for Long-Form Video QAcited by 68
- 2025Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledgecited by 68
- 2024DrVideo: Document Retrieval Based Long Video Understandingcited by 63
- 2024VCA: Video Curious Agent for Long Video Understandingcited by 54
- 2023ChatGPT for Shaping the Future of Dentistry: The Potential of Multi-Modal Large Language Modelcited by 40
- 2025VideoLucy: Deep Memory Backtracking for Long Video Understandingcited by 21
- 2024HERMES: temporal-coHERent long-forM understanding with Episodes and Semanticscited by 11
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
- 2026ProMAS: Proactive Error Forecasting for Multi-Agent Systems Using Markov Transition Dynamicscited by 2
- 2026ATOM: Instantiating Budget-Controllable Multi-Agent Collaboration via Nucleus-Electron Hierarchycited by 1
- 2026Hi-GaTA: Hierarchical Gated Temporal Aggregation Adapter for Surgical Video Report Generationcited by 0
- 2026ATOM: Instantiating Budget-Controllable Multi-Agent Collaboration via Nucleus-Electron Hierarchy25 May 2026
- 2026Hi-GaTA: Hierarchical Gated Temporal Aggregation Adapter for Surgical Video Report Generation11 May 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2026ProMAS: Proactive Error Forecasting for Multi-Agent Systems Using Markov Transition Dynamics12 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Video Finetuning Improves Reasoning Between Frames
- 2026LongVideo-R1: Smart Navigation for Low-cost Long Video Understanding
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcing
- 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition
- 2026WAT: Online Video Understanding Needs Watching Before Thinking
- 2026Temporal Tree of Thought: Reasoning-Guided Visual Cue Search for Long-Video Understanding
- 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
- 2024Perceive, Query & Reason: Enhancing Video QA with Question-Guided Temporal Queries