Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Reinforcement learning has improved the reasoning ability of large language models, but applying outcome-only rewards to video multimodal large language models (Video-MLLMs) provides limited guidance on which visual evidence should support the answer. Inspired by multisensory integration, where consistent cues can enhance the salience and reliability of perceptual estimates, we introduce Consensus Frame GRPO (CF-GRPO), a temporal-annotation-free process-level reward framework for evidence-aware video reasoning. CF-GRPO constructs a consensus frame prior from intrinsic video cues, including temporal coverage, scene-transition cues, and query-conditioned visual relevance. It then computes a model-side frame-use score from visual and response representations and optimizes their agreement through the Consensus Frame Reward (CFR). With salience-aware sparse aggregation and distribution sharpening, CFR provides a high-contrast reward signal without requiring human temporal annotations. Experiments show that VideoCFR achieves competitive performance across complex video reasoning benchmarks and improves several metrics over representative Video-MLLM and RL baselines, while the consensus prior provides an interpretable view of the evidence frames emphasized during training. The implementation is available at https://github.com/1Pansy/VideoCFR.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 38 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
32 of 38 references.
Closest ancestors · 8
Same direction, newest first
- 2025Perceptual-Evidence Anchored Reinforced Learning for Multimodal Reasoning23 Nov
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning6 Aug
- 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency2 Jun
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
- 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning13 Apr
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning13 Mar
Other references · 24
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Let's Verify Step by Stepcited by 3,598
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2022Solving math word problems with process- and outcome-based feedbackcited by 871
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
- 2023VILA: On Pre-training for Visual Language Modelscited by 686
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
- 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 539
12 more
- 2024Long Context Transfer from Language to Visioncited by 502
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 352
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
- 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 153
- 2024Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Inputcited by 132
- 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 131
- 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 57
- 2025Unhackable Temporal Rewarding for Scalable Video MLLMscited by 33
- 2025FOCUS: Efficient Keyframe Selection for Long Video Understandingcited by 30
- 2025SpaceVLLM: Endowing Multimodal Large Language Model with Spatio-Temporal Video Grounding Capabilitycited by 28
- 2025MARC: Memory-Augmented RL Token Compression for Efficient Video Understandingcited by 6
- 2025SeViCES: Unifying Semantic-Visual Evidence Consensus for Long Video Understandingcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
- 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
- 2025VideoZoomer: Reinforcement-Learned Temporal Focusing for Long Video Reasoning
- 2025Reinforcing Video Reasoning with Focused Thinking
- 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoning
- 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting
- 2026Incentivizing Temporal-Awareness in Egocentric Video Understanding Models
- 2026Reinforcing Consistency in Video MLLMs with Structured Rewards