Reinforce to Learn, Elect to Reason: A Dual Paradigm for Video Reasoning
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
Abstract (arXiv)
Video reasoning has advanced with large multimodal models (LMMs), yet their inference is often a single pass that returns an answer without verifying whether the reasoning is evidence-aligned. We introduce Reinforce to Learn, Elect to Reason (RLER), a dual paradigm that decouples learning to produce evidence from obtaining a reliable answer. In RLER-Training, we optimize the policy with group-relative reinforcement learning (RL) and 3 novel task-driven rewards: Frame-sensitive reward grounds reasoning on explicit key frames, Think-transparency reward shapes readable and parsable reasoning traces, and Anti-repetition reward boosts information density. These signals teach the model to emit structured, machine-checkable evidence and potentiate reasoning capabilities. In RLER-Inference, we apply a train-free orchestrator that generates a small set of diverse candidates, parses their answers and cited frames, scores them by evidence consistency, confidence, transparency, and non-redundancy, and then performs a robust evidence-weighted election. This closes the loop between producing and using evidence, improving reliability and interpretability without enlarging the model. We comprehensively evaluate RLER against various open-source and RL-based LMMs on 8 representative benchmarks. RLER achieves state of the art across all benchmarks and delivers an average improvement of 6.3% over base models, while using on average 3.1 candidates per question, indicating a favorable balance between compute and quality. The results support a simple thesis: making evidence explicit during learning and electing by evidence during inference is a robust path to trustworthy video reasoning.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 50 of its 58 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
50 of 58 references.
Closest ancestors · 12
Same direction, newest first
- 2025MOSS-ChatV: Reinforcement Learning with Process Reasoning Reward for Video Temporal Reasoning25 Sep
- 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning13 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2024CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understanding16 Dec
- 2024From Seconds to Hours: Reviewing MultiModal Large Language Models on Comprehensive Long Video Understanding27 Sep
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Models9 Aug
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding22 Jul
- 2024Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMs13 Jun
- 2024LVBench: An Extreme Long Video Understanding Benchmark12 Jun
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis31 May
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmark28 Nov
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding5 Jun
Other references · 38
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Visual Instruction Tuningcited by 7,869
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
26 more
- 2024Yi: Open Foundation Models by 01.AIcited by 719
- 2023VILA: On Pre-training for Visual Language Modelscited by 692
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 388
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
- 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Trainingcited by 295
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 251
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
- 2023Self-Evaluation Guided Beam Search for Reasoningcited by 196
- 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 165
- 2024BoNBoN Alignment for Large Language Models and the Sweetness of Best-of-n Samplingcited by 121
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuningcited by 93
- 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learningcited by 69
- 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 65
- 2025DyFo: A Training-Free Dynamic Focus Visual Search for Enhancing LMMs in Fine-Grained Visual Understandingcited by 49
- 2024VideoQA in the Era of LLMs: An Empirical Studycited by 29
- 2025STAR-R1: Spatial TrAnsformation Reasoning by Reinforcing Multimodal LLMscited by 21
- 2024On the Consistency of Video Large Language Models in Temporal Comprehensioncited by 18
- 2025Commonsense Video Question Answering through Video-Grounded Entailment Tree Reasoningcited by 12
- 2022Learning to Purification for Unsupervised Person Re-identificationcited by 11
- 2025VReST: Enhancing Reasoning in Large Vision-Language Models through Tree Search and Self-Reward Mechanismcited by 7
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Select Less, Reason More: Prioritizing Evidence Purity for Video Reasoning
- 2025Video Reasoning without Training
- 2026AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning
- 2026Find, Fix, Reason: Context Repair for Video Reasoning
- 2025Conan: Progressive Learning to Reason Like a Detective over Multi-Scale Visual Evidence
- 2025Reinforcing Video Reasoning with Focused Thinking
- 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
- 2025Boosting Reasoning in Large Multimodal Models via Activation Replay