mlsanityData to 14 Oct 2026

Question-Aware Evidence Ledgers for Video Relational Reasoning

arXiv 2606.02506 ↗First posted 1 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The VRR-QA challenge evaluates visual relational reasoning in videos, where answers often depend on implicit spatial relations, event boundaries, target identity, and dialogue context rather than a single salient frame. We present a test-time reasoning pipeline built around a strong GPT-5.5 video QA solver and a set of question-aware evidence ledgers. The initial solver answers each question from a uniform video representation, while routed ledgers are prompted to make the required targets, count units, reference frames, and temporal or spatial scope explicit for counting, spatial, endpoint, viewpoint, and dialogue reasoning. External tools such as open-vocabulary detection, depth cues, pair crops, ASR, and scene-graph ledgers are used only as evidence sources. A conservative gate keeps the current answer unless independent evidence uniquely supports a different option. The final evidence-gated pipeline achieves 92.95% overall accuracy and 93.79% macro accuracy on the challenge test split.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 26 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

23 of 26 references.

References · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  6. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  7. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  9. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  10. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  11. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  12. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
11 more
  1. 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
  2. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
  3. 2018TVQA: Localized, Compositional Video Question Answeringcited by 467
  4. 2023Weakly-Supervised Temporal Action Localization by Inferring Salient Snippet-Featurecited by 22
  5. 2025Action Quality Assessment via Hierarchical Pose-guided Multi-stage Contrastive Regressioncited by 21
  6. 2025Robust Disentangled Counterfactual Learning for Physical Audiovisual Commonsense Reasoningcited by 20
  7. 2025DC-SAM: In-Context Segment Anything in Images and Videos via Dual Consistencycited by 15
  8. 2025Explainable Action Form Assessment by Exploiting Multimodal Chain-of-Thoughts Reasoningcited by 14
  9. 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimationcited by 12
  10. 2025VRR-QA: Visual Relational Reasoning in Videos Beyond Explicit Cuescited by 8
  11. 2024Towards Autonomous Agents: Adaptive-planning, Reasoning, and Acting in Language Modelscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Adaptive Dense Evidence Refinement for Video Relational Reasoning for VRR-QA Challenge
  2. 2025VITED: Video Temporal Evidence Distillation
  3. 2026CaST-Bench: Benchmarking Causal Chain-Grounded Spatio-Temporal Reasoning for Video Question Answering
  4. 2026Temporal Evidence Routing with Structured Visual Evidence for TimeLogicQA
  5. 2026Perception Before Reasoning: Dynamic Latent Reasoning for Video Understanding and Question Answering
  6. 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning
  7. 2025Rethinking Chain-of-Thought Reasoning for Videos
  8. 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection