mlsanityData to 7 Oct 2026

When No Answer Is Correct: Diagnosing Absent Answer Detection for MLLMs in Video Understanding

arXiv 2606.08239 ↗First posted 6 Jun 2026cs.AI cs.CL cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

Abstract (arXiv)

Multimodal large language models (MLLMs) have made substantial advancements in video understanding, yet the reliability of their responses remains underexplored. This work presents a diagnostic study of absent answer detection for MLLMs in video understanding, where the correct answer is deliberately excluded from the candidate set and a reliable model is expected to recognize that no valid option exists. We evaluate the absent answer detection behavior under three settings: multiple-choice questions augmented with an ``None of the Above'' option, open-ended generation with a detection instruction, and standard evaluation without any guidance. Across a diverse set of models and benchmarks, we find that MLLMs overwhelmingly select plausible distractors rather than detecting the absent answer. This failure is more pronounced in temporal reasoning tasks and worsens with denser frame sampling. We further explore chain-of-thought prompting as a mitigation strategy and find that while it substantially improves detection rates, performance remains unsatisfactory, suggesting that prompting-based strategies alone are insufficient to fully address this limitation. These findings expose a systematic failure in absent answer detection and highlight the need for explicit detection mechanisms in multimodal systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 19 of its 22 references that are in the map. First posted on arXiv 6 Jun 2026.

Builds on

19 of 22 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026VirtueBench: Evaluating Trustworthiness under Uncertainty in Long Video Understanding7 Mar
  2. 2025Can Video LLMs Refuse to Answer? Alignment for Answerability in Video Large Language Models7 Jul
  3. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding22 Jul
  4. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis31 May
  5. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmark28 Nov

Other references · 14

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2025Qwen3-VL Technical Reportcited by 2,534
  5. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  6. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  7. 2025Qwen2.5-Omni Technical Reportcited by 704
  8. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
  9. 2025Qwen3-Omni Technical Reportcited by 451
  10. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
  11. 2026MIRAGE: The Illusion of Visual Understandingcited by 57
  12. 2024LLMs May Perform MCQA by Selecting the Least Incorrect Optioncited by 32
2 more
  1. 2024Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Modelscited by 12
  2. 2024Wait, that's not an option: LLMs Robustness with Incorrect Multiple-Choice Optionscited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Exploring Response Uncertainty in MLLMs: An Empirical Evaluation under Misleading Scenarios
  2. 2026Knowing When Not to Answer: Evaluating Abstention in Multimodal Reasoning Systems
  3. 2025MMR-V: What's Left Unsaid? A Benchmark for Multimodal Deep Reasoning in Videos
  4. 2024Unveiling the Ignorance of MLLMs: Seeing Clearly, Answering Incorrectly
  5. 2025Seeing but Not Believing: Probing the Disconnect Between Visual Attention and Answer Correctness in VLMs
  6. 2024CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understanding
  7. 2024Addressing Blind Guessing: Calibration of Selection Bias in Multiple-Choice Question Answering by Video Language Models
  8. 2025An Empirical Study for Representations of Videos in Video Question Answering via MLLMs