MVP: Enhancing Video Large Language Models via Self-supervised Masked Video Prediction
Not on the map. Why?
Abstract (arXiv)
Reinforcement learning based post-training paradigms for Video Large Language Models (VideoLLMs) have achieved significant success by optimizing for visual-semantic tasks such as captioning or VideoQA. However, while these approaches effectively enhance perception abilities, they primarily target holistic content understanding, often lacking explicit supervision for intrinsic temporal coherence and inter-frame correlations. This tendency limits the models' ability to capture intricate dynamics and fine-grained visual causality. To explicitly bridge this gap, we propose a novel post-training objective: Masked Video Prediction (MVP). By requiring the model to reconstruct a masked continuous segment from a set of challenging distractors, MVP forces the model to attend to the sequential logic and temporal context of events. To support scalable training, we introduce a scalable data synthesis pipeline capable of transforming arbitrary video corpora into MVP training samples, and further employ Group Relative Policy Optimization (GRPO) with a fine-grained reward function to enhance the model's understanding of video context and temporal properties. Comprehensive evaluations demonstrate that MVP enhances video reasoning capabilities by directly reinforcing temporal reasoning and causal understanding.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 43 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
28 of 43 references.
References · 28
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
- 2017TALL: Temporal Activity Localization via Language Querycited by 584
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
- 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 137
16 more
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 118
- 2025BOLT: Boost Large Vision-Language Model Without Training for Long-form Video Understandingcited by 75
- 2025Kwai Keye-VL 1.5 Technical Reportcited by 73
- 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queriescited by 72
- 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 65
- 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 61
- 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 38
- 2024HRVDA: High-Resolution Visual Document Assistantcited by 37
- 2025SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understandingcited by 30
- 2025LOVE-R1: Advancing Long Video Understanding with an Adaptive Zoom-in Mechanism via Multi-Step Reasoningcited by 27
- 2025TSPO: Temporal Sampling Policy Optimization for Long-form Video Language Understandingcited by 25
- 2023Attention Where It Matters: Rethinking Visual Document Understanding with Selective Region Concentrationcited by 18
- 2025Fostering Video Reasoning via Next-Event Predictioncited by 18
- 2025VCapsBench: A Large-scale Fine-grained Benchmark for Video Caption Quality Evaluationcited by 9
- 2025VideoSSR: Video Self-Supervised Reinforcement Learningcited by 6
- 2025Input Domain Aware MoE: Decoupling Routing Decisions from Task Optimization in Mixture of Expertscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoning
- 2026Enhancing Localized Reasoning for Long Video Understanding via Efficient Segment-to-Video Supervision
- 2026EasyVideoR1: Easier RL for Video Understanding
- 2026Video-ToC: Video Tree-of-Cue Reasoning
- 2025From Trial to Triumph: Advancing Long Video Understanding via Visual Context Sample Scaling and Self-reward Alignment
- 2026VideoTIR: Accurate Understanding for Long Videos with Efficient Tool-Integrated Reasoning
- 2025TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action
- 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency