mlsanityData to 14 Oct 2026

MEDR: Query-Independent Frame Selection via Multi-Signal Event Modeling and Dynamic Rescoring

arXiv 2608.15058 ↗First posted 15 Aug 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

Abstract (arXiv)

Frame selection is a fundamental component of multimodal large language models, enabling long videos to be processed under limited visual-token and computational budgets. Uniform sampling preserves temporal coverage but may miss informative content that appears only briefly. To alleviate this limitation, query-dependent methods can retrieve question-relevant frames. However, because the selected frames depend on the current question, the same visual input cannot be directly shared across different questions, and frame selection must be repeated in multi-turn video dialogue. This motivates us to seek a query-independent frame selection method that preserves the reusability of a fixed visual input while improving the coverage of informative events beyond uniform sampling. We propose Multi-Signal Event Modeling and Dynamic Rescoring (MEDR), a training-free and query-independent frame selection method. Multi-Signal Event Modeling organizes complementary visual, motion, and text signals into signal-specific temporal events. Dynamic Rescoring then iteratively reevaluates each candidate relative to the current selected set, updating its score according to frame-level signal strength, additional event coverage, and temporal proximity. The resulting fixed frame set is constructed without observing the query and can be reused across different questions. On the standard benchmark evaluations, MEDR improves model accuracy by 0.63%-0.89% on Video-MME. On the long-video subset of LongVideoBench, it improves accuracy by up to 1.23% with Qwen3-VL-8B. MEDR further improves overall accuracy by 0.53%, while reusing exactly the same frame set for every question about a video.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 16 of its 25 references that are in the map. First posted on arXiv 15 Aug 2026.

Builds on

16 of 25 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026KTV: Keyframes and Key Tokens Selection for Efficient Training-Free Video LLMs3 Feb
  2. 2025M-LLM Based Video Frame Selection for Efficient Video Understanding27 Feb
  3. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understanding22 Oct
  4. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding22 Jul
  5. 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding18 Mar
  6. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmark28 Nov
  7. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projection16 Nov

Other references · 9

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
  3. 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 371
  4. 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 251
  5. 2024An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLMcited by 97
  6. 2024Koala: Key frame-conditioned long video-LLMcited by 57
  7. 2025MDP3: A Training-free Approach for List-wise Frame Selection in Video-LLMscited by 43
  8. 2024FreeVA: Offline MLLM as Training-Free Video Assistantcited by 29
  9. 2025MaxInfo: A Training-Free Key-Frame Selection Method Using Maximum Volume for Enhanced Video Understandingcited by 18

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026HiMu: Hierarchical Multimodal Frame Selection for Long Video Question Answering
  2. 2026ReQuest: Rethinking-based Question-Aware Frame Selection for Long-Form Video QA
  3. 2026Efficient Frame Selection for Long Videos at Test Time with Attention-Based MLLM Selectors
  4. 2026Adaptive Greedy Frame Selection for Long Video Understanding
  5. 2026MetaSampling: Making Frame Samplers Efficient for Long-Video Question Answering
  6. 2025FOCUS: Efficient Keyframe Selection for Long Video Understanding
  7. 2025Q-Frame: Query-aware Frame Selection and Multi-Resolution Adaptation for Video-LLMs
  8. 2026Where to Focus: Query-Modulated Multimodal Keyframe Selection for Long Video Understanding