Beyond Perceptual Shortcuts: Causal-Inspired Debiasing Optimization for Generalizable Video Reasoning in Lightweight MLLMs
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Although reinforcement learning (RL) has significantly advanced reasoning capabilities in large multimodal language models (MLLMs), its efficacy remains limited for lightweight models essential for edge deployments. To address this issue, we leverage causal analysis and experiment to reveal the underlying phenomenon of perceptual bias, demonstrating that RL-based fine-tuning compels lightweight models to preferentially adopt perceptual shortcuts induced by data biases, rather than developing genuine reasoning abilities. Motivated by this insight, we propose VideoThinker, a causal-inspired framework that cultivates robust reasoning in lightweight models through a two-stage debiasing process. First, the Bias Aware Training stage forges a dedicated "bias model" to embody these shortcut behaviors. Then, the Causal Debiasing Policy Optimization (CDPO) algorithm fine-tunes the primary model, employing an innovative repulsive objective to actively push it away from the bias model's flawed logic while simultaneously pulling it toward correct, generalizable solutions. Our model, VideoThinker-R1, establishes a new state-of-the-art in video reasoning efficiency. For same-scale comparison, requiring no Supervised Fine-Tuning (SFT) and using only 1 of the training data for RL, it surpasses VideoRFT-3B with a 3.2% average gain on widely-used benchmarks and a 7% lead on VideoMME. For cross-scale comparison, it outperforms the larger Video-UTR-7B model on multiple benchmarks, including a 2.1% gain on MVBench and a 3.8% gain on TempCompass. Code is available at https://github.com/falonss703/VideoThinker.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 51 references that are in the map. First posted on arXiv 2 May 2026.
Builds on
41 of 51 references.
Closest ancestors · 7
Same direction, newest first
- 2025Reinforcing Video Reasoning with Focused Thinking30 May
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
- 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning13 Apr
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Models23 May
Other references · 34
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
- 2023VILA: On Pre-training for Visual Language Modelscited by 686
- 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 539
- 2024Long Context Transfer from Language to Visioncited by 502
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
22 more
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 352
- 2020Counterfactual VQA: A Cause-Effect Look at Language Biascited by 266
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
- 2021Deep Stable Learning for Out-Of-Distribution Generalizationcited by 153
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 131
- 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 84
- 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learningcited by 68
- 2024Multi-Object Hallucination in Vision-Language Modelscited by 60
- 2024Mitigating Modality Prior-Induced Hallucinations in Multimodal Large Language Models via Deciphering Attention Causalitycited by 42
- 2024Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal Perspectivecited by 39
- 2025Fast-Slow Thinking GRPO for Large Vision-Language Model Reasoningcited by 34
- 2025Unhackable Temporal Rewarding for Scalable Video MLLMscited by 33
- 2022Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQAcited by 30
- 2023Beyond Task Performance: Evaluating and Reducing the Flaws of Large Multimodal Models with In-Context Learningcited by 30
- 2023Link-Context Learning for Multimodal LLMscited by 24
- 2024View-decoupled Transformer for Person Re-identification under Aerial-ground Camera Networkcited by 21
- 2024Assessing Modality Bias in Video Question Answering Benchmarks with Multimodal Large Language Modelscited by 21
- 2025Debiasing Multimodal Large Language Models via Noise-Aware Preference Optimizationcited by 14
- 2025Cross-modal Causal Relation Alignment for Video Question Groundingcited by 12
- 2023Causal-CoG: A Causal-Effect Look at Context Generation for Boosting Multi-modal Language Modelscited by 10
- 2023Language Models are Causal Knowledge Extractors for Zero-shot Video Question Answeringcited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
- 2025ReasonAct: Progressive Training for Fine-Grained Video Reasoning in Small Models
- 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1
- 2026AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning
- 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoning
- 2025Video Reasoning without Training
- 2025Select Less, Reason More: Prioritizing Evidence Purity for Video Reasoning