mlsanityData to 14 Oct 2026

Answer Self-Consistency with Margin-Triggered Question Re-Arbitration for the CVPR 2026 VidLLMs Challenge

arXiv 2606.04323 ↗First posted 3 Jun 2026cs.CVcited by 2

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

In this report, we present our solution for Track 2 of the CVPR 2026 VidLLMs Challenge. This track evaluates visual relational reasoning in videos, where models must infer relations that are not always explicitly visible. We propose Answer Self-Consistency with Margin-Triggered Question Re-Arbitration (ASC-MQRA), a training-free test-time reasoning framework built on a multimodal reasoning model. The core ASC component performs multiple stochastic video question-answering runs and aggregates their answer choices through answer-level self-consistency. This substantially improves over single-pass inference and forms our final test submission. We further study MQRA, a conditional re-arbitration module for low-margin examples where the first-stage vote distribution indicates uncertainty. Our vote-margin analysis shows that low-margin examples often retain the ground-truth answer among the top candidates, motivating MQRA to narrow the candidate set and re-watch the video only over the retained candidates. On validation, MQRA further improves over ASC, indicating that low-margin vote distributions can provide a useful uncertainty signal. On test, however, MQRA slightly degrades performance relative to ASC, suggesting that re-arbitration is sensitive to the size and category distribution of the triggered subset. Our final test submission therefore uses ASC without re-arbitration, achieving 72.73 average accuracy and 78.34 category-wise macro average accuracy on validation, and 81.16 average accuracy and 80.91 category-wise macro average accuracy on test. This report details our prompting strategy, implementation setup, ablation studies, and diagnostic analyses. The code is available at https://github.com/data-analytics-labo/ASC-MQRA

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 5 of its 15 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

5 of 15 references.

References · 5

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  2. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  3. 2025Confidence Improves Self-Consistency in LLMscited by 113
  4. 2025VRR-QA: Visual Relational Reasoning in Videos Beyond Explicit Cuescited by 8
  5. 2025Moment Sampling in Video LLMs for Long-Form Video QAcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EG-VQA: Benchmarking Verifiable Video Question Answering with Grounded Temporal Evidence
  2. 2023Logical Implications for Visual Question Answering Consistency
  3. 2026Question-Aware Evidence Ledgers for Video Relational Reasoning
  4. 2025ReasVQA: Advancing VideoQA with Imperfect Reasoning Process
  5. 2024Align and Aggregate: Compositional Reasoning with Video Alignment and Answer Aggregation for Video Question-Answering
  6. 2024Addressing Blind Guessing: Calibration of Selection Bias in Multiple-Choice Question Answering by Video Language Models
  7. 2025Confidence-guided Refinement Reasoning for Zero-shot Question Answering
  8. 2026Accuracy and Cost Claims Do Not Survive Re-Execution in Agentic VideoQA