mlsanityData to 14 Oct 2026

CRAFT: Critic-Refined Adaptive Key-Frame Targeting for Multimodal Video Question Answering

arXiv 2605.19075 ↗First posted 18 May 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Grounded multi-video question answering over real-world news events requires systems to surface query-relevant evidence across heterogeneous video archives while attributing every claim to its supporting source. We introduce CRAFT (Critic-Refined Adaptive Key-Frame Targeting), a query-conditioned pipeline that combines dynamic keyframe selection, per-video ASR with multilingual fallback, and a hybrid critic loop to iteratively verify and repair claims before consolidation. The pipeline integrates UNLI temporal entailment, DeBERTa-v3 cross-claim screening, and a Llama-3.2-3B adjudicator, with a final citation-merging stage that emits each fact once with all supporting source identifiers. On MAGMaR 2026, CRAFT achieves the best overall average (0.739), reference recall (0.810), and citation F1 (0.635). We further evaluate on a MAGMaR-style conversion of WikiVideo with 52 non-overlapping event queries, where CRAFT also performs strongly (0.823 Avg), showing that its claim-centric evidence aggregation generalizes beyond MAGMaR. Ablations show that atomic claims, ASR, and the critic loop drive the main gains over the vanilla query-conditioned baseline. Code and implementation details are publicly available at https://github.com/bhosalems/CRAFT.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

34 of 43 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  4. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  6. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  7. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  8. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  9. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 356
  10. 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 332
  11. 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 251
  12. 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understandingcited by 229
22 more
  1. 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 213
  2. 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
  3. 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 98
  4. 2024VideoHallucer: Evaluating Intrinsic and Extrinsic Hallucinations in Large Video-Language Modelscited by 90
  5. 2025T*: Re-thinking Temporal Search for Long-Form Video Understandingcited by 82
  6. 2025Q-Frame: Query-aware Frame Selection and Multi-Resolution Adaptation for Video-LLMscited by 80
  7. 2025VideoRAG: Retrieval-Augmented Generation with Extreme Long-Context Videoscited by 77
  8. 2024VidHalluc: Evaluating Temporal Hallucinations in Multimodal Large Language Models for Video Understandingcited by 68
  9. 2024EventHallusion: Diagnosing Event Hallucinations in Video LLMscited by 57
  10. 2025VideoRAG: Retrieval-Augmented Generation over Video Corpuscited by 57
  11. 2024Careless Whisper: Speech-to-Text Hallucination Harmscited by 53
  12. 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoningcited by 43
  13. 2025VideoAgent2: Enhancing the LLM-Based Agent System for Long-Form Video Understanding by Uncertainty-Aware CoTcited by 38
  14. 2024End-to-End Video Question Answering with Frame Scoring Mechanisms and Adaptive Samplingcited by 19
  15. 2024MultiVENT 2.0: A Massive Multilingual Benchmark for Event-Centric Video Retrievalcited by 17
  16. 2025WikiVideo: Article Generation from Multiple Videoscited by 13
  17. 2025From Frames to Clips: Training-free Adaptive Key Clip Selection for Long-Form Video Understandingcited by 9
  18. 2025AdaRD-key: Adaptive Relevance-Diversity Keyframe Sampling for Long-form Video understandingcited by 9
  19. 2025MMMORRF: Multimodal Multilingual Modularized Reciprocal Rank Fusioncited by 8
  20. 2025APVR: Hour-Level Long Video Understanding with Adaptive Pivot Visual Information Retrievalcited by 7
  21. 2025SceneRAG: Scene-level Retrieval-Augmented Generation for Video Understandingcited by 7
  22. 2026Unified Multimodal Uncertain Inferencecited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.