FADE: From Passive Verification to Active Discovery in Counterfactual Video Understanding
Not on the map. Why?
Abstract (arXiv)
Counterfactual video understanding evaluates whether models grasp physical and commonsense regularities. However, existing multiple-choice question (MCQ) benchmarks inadvertently leak target events through their questions and candidate options. This reduces the core challenge from active discovery to text-guided verification. In this paper, we present FADE, an effective training framework for counterfactual discovery and explanation. Our method is built on an evidence-first, two-stage training paradigm. First, evidence-internalized supervised fine-tuning grounds the model's predictions in decisive visual anomalies. Second, we apply a fading-anchor reinforcement learning strategy that progressively removes textual guidance, compelling the model to independently discover and explain evidence. To rigorously evaluate this capability, we also introduce an effective pipeline that converts existing MCQ datasets into aligned MCQ, open-ended question answering (OQA), and captioning tasks without requiring additional data curation. Our simple approach yields strong results. Using Qwen3-VL-8B as the baseline, FADE achieves state-of-the-art strict paired scores across all three tasks on DualityVidQA-test and IPV-Bench, outperforming GPT-5.6. In specific, when transitioning from constrained MCQs to unconstrained OQA and captioning, our model demonstrates remarkable robustness. Its performance retention is 90.4% and 67.4% on DualityVidQA-test-substantially higher than the 48.1% and 30.7% retained by GPT-5.6. We hope this simple framework can serve as a solid baseline for future research in unconstrained counterfactual video understanding.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 34 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
24 of 34 references.
References · 24
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2017Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answeringcited by 339
- 2020Counterfactual VQA: A Cause-Effect Look at Language Biascited by 266
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
- 2019RUBi: Reducing Unimodal Biases in Visual Question Answeringcited by 185
12 more
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
- 2024TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Modelscited by 97
- 2019CoPhy: Counterfactual Learning of Physical Dynamicscited by 81
- 2025IntPhys 2: Benchmarking Intuitive Physics Understanding In Complex Synthetic Environmentscited by 52
- 2025A Shortcut-aware Video-QA Benchmark for Physical Understanding via Minimal Video Pairscited by 30
- 2025TRAVL: A Recipe for Making Video-Language Models Better Judges of Physics Implausibilitycited by 18
- 2025Enrich and Detect: Video Temporal Grounding with Multimodal LLMscited by 12
- 2024Addressing Blind Guessing: Calibration of Selection Bias in Multiple-Choice Question Answering by Video Language Modelscited by 11
- 2025Reasoning is All You Need for Video Generalization: A Counterfactual Benchmark with Sub-question Evaluationcited by 6
- 2025RAVEN: Robust Advertisement Video Violation Temporal Grounding via Reinforcement Reasoningcited by 5
- 2023X-VoE: Measuring eXplanatory Violation of Expectation in Physical Eventscited by 3
- 2026Video-Oasis: Rethinking Evaluation of Video Understandingcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Distilling Counterfactual Reasoning from Language to Vision: Causal Graph Guided Post-Training for Video Understanding
- 2026Incentivizing Vision Language Models to Search for Long Video Question Answering
- 2026CueKFS: Agentic Cue-Driven Keyframe Selection for Long Video Understanding
- 2026Query-Conditioned Evidential Keyframe Sampling for MLLM-Based Long-Form Video Understanding
- 2026Beyond Frame Selection: Generative Latent Evidence Aggregation for Long-Video Understanding
- 2026Perception Before Reasoning: Dynamic Latent Reasoning for Video Understanding and Question Answering
- 2023ACQUIRED: A Dataset for Answering Counterfactual Questions In Real-Life Videos
- 2026VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority