mlsanityData to 7 Oct 2026

Video-QTR: Query-Driven Temporal Reasoning Framework for Lightweight Video Understanding

arXiv 2512.09354 ↗First posted 10 Dec 2025cs.CVcited by 4

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

The rapid development of multimodal large-language models (MLLMs) has significantly expanded the scope of visual language reasoning, enabling unified systems to interpret and describe complex visual content. However, applying these models to long-video understanding remains computationally intensive. Dense frame encoding generates excessive visual tokens, leading to high memory consumption, redundant computation, and limited scalability in real-world applications. This inefficiency highlights a key limitation of the traditional process-then-reason paradigm, which analyzes visual streams exhaustively before semantic reasoning. To address this challenge, we introduce Video-QTR (Query-Driven Temporal Reasoning), a lightweight framework that redefines video comprehension as a query-guided reasoning process. Instead of encoding every frame, Video-QTR dynamically allocates perceptual resources based on the semantic intent of the query, creating an adaptive feedback loop between reasoning and perception. Extensive experiments across five benchmarks: MSVD-QA, Activity Net-QA, Movie Chat, and Video MME demonstrate that Video-QTR achieves state-of-the-art performance while reducing input frame consumption by up to 73%. These results confirm that query-driven temporal reasoning provides an efficient and scalable solution for video understanding.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 46 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

40 of 46 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLM27 Mar
  2. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
  3. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language1 Apr

Other references · 37

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  6. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  7. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  8. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  9. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  10. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  11. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
  12. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
25 more
  1. 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,038
  2. 2023VideoChat: Chat-Centric Video Understandingcited by 851
  3. 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 539
  4. 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
  5. 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 368
  6. 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 320
  7. 2023Valley: Video Assistant with Large Language model Enhanced abilitYcited by 231
  8. 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understandingcited by 223
  9. 2022MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognitioncited by 189
  10. 2024VITA: Towards Open-Source Interactive Omni Multimodal LLMcited by 172
  11. 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 160
  12. 2023mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Videocited by 154
  13. 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 153
  14. 2021Towards Long-Form Video Understandingcited by 146
  15. 2024LongVLM: Efficient Long Video Understanding via Large Language Modelscited by 146
  16. 2024ST-LLM: Large Language Models Are Effective Temporal Learnerscited by 126
  17. 2023Selective Structured State-Spaces for Long-Form Video Understandingcited by 105
  18. 2024MovieChat+: Question-aware Sparse Memory for Long Video Question Answeringcited by 73
  19. 2024Too Many Frames, Not All Useful: Efficient Strategies for Long-Form Video QAcited by 68
  20. 2025Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledgecited by 68
  21. 2024DrVideo: Document Retrieval Based Long Video Understandingcited by 63
  22. 2024VCA: Video Curious Agent for Long Video Understandingcited by 54
  23. 2023ChatGPT for Shaping the Future of Dentistry: The Potential of Multi-Modal Large Language Modelcited by 40
  24. 2025VideoLucy: Deep Memory Backtracking for Long Video Understandingcited by 21
  25. 2024HERMES: temporal-coHERent long-forM understanding with Episodes and Semanticscited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Video Finetuning Improves Reasoning Between Frames
  2. 2026LongVideo-R1: Smart Navigation for Low-cost Long Video Understanding
  3. 2026VideoLatent: Video-Language Learning via Latent Self-Forcing
  4. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition
  5. 2026WAT: Online Video Understanding Needs Watching Before Thinking
  6. 2026Temporal Tree of Thought: Reasoning-Guided Visual Cue Search for Long-Video Understanding
  7. 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  8. 2024Perceive, Query & Reason: Enhancing Video QA with Question-Guided Temporal Queries