mlsanityData to 14 Oct 2026

MVP: Enhancing Video Large Language Models via Self-supervised Masked Video Prediction

arXiv 2601.03781 ↗First posted 7 Jan 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Reinforcement learning based post-training paradigms for Video Large Language Models (VideoLLMs) have achieved significant success by optimizing for visual-semantic tasks such as captioning or VideoQA. However, while these approaches effectively enhance perception abilities, they primarily target holistic content understanding, often lacking explicit supervision for intrinsic temporal coherence and inter-frame correlations. This tendency limits the models' ability to capture intricate dynamics and fine-grained visual causality. To explicitly bridge this gap, we propose a novel post-training objective: Masked Video Prediction (MVP). By requiring the model to reconstruct a masked continuous segment from a set of challenging distractors, MVP forces the model to attend to the sequential logic and temporal context of events. To support scalable training, we introduce a scalable data synthesis pipeline capable of transforming arbitrary video corpora into MVP training samples, and further employ Group Relative Policy Optimization (GRPO) with a fine-grained reward function to enhance the model's understanding of video context and temporal properties. Comprehensive evaluations demonstrate that MVP enhances video reasoning capabilities by directly reinforcing temporal reasoning and causal understanding.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 43 references that are in the map. First posted on arXiv 7 Jan 2026.

Builds on

28 of 43 references.

References · 28

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
  5. 2017TALL: Temporal Activity Localization via Language Querycited by 584
  6. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  7. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  8. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
  9. 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
  10. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
  11. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
  12. 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 137
16 more
  1. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 118
  2. 2025BOLT: Boost Large Vision-Language Model Without Training for Long-form Video Understandingcited by 75
  3. 2025Kwai Keye-VL 1.5 Technical Reportcited by 73
  4. 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queriescited by 72
  5. 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 65
  6. 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 61
  7. 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 38
  8. 2024HRVDA: High-Resolution Visual Document Assistantcited by 37
  9. 2025SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understandingcited by 30
  10. 2025LOVE-R1: Advancing Long Video Understanding with an Adaptive Zoom-in Mechanism via Multi-Step Reasoningcited by 27
  11. 2025TSPO: Temporal Sampling Policy Optimization for Long-form Video Language Understandingcited by 25
  12. 2023Attention Where It Matters: Rethinking Visual Document Understanding with Selective Region Concentrationcited by 18
  13. 2025Fostering Video Reasoning via Next-Event Predictioncited by 18
  14. 2025VCapsBench: A Large-scale Fine-grained Benchmark for Video Caption Quality Evaluationcited by 9
  15. 2025VideoSSR: Video Self-Supervised Reinforcement Learningcited by 6
  16. 2025Input Domain Aware MoE: Decoupling Routing Decisions from Task Optimization in Mixture of Expertscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoning
  2. 2026Enhancing Localized Reasoning for Long Video Understanding via Efficient Segment-to-Video Supervision
  3. 2026EasyVideoR1: Easier RL for Video Understanding
  4. 2026Video-ToC: Video Tree-of-Cue Reasoning
  5. 2025From Trial to Triumph: Advancing Long Video Understanding via Visual Context Sample Scaling and Self-reward Alignment
  6. 2026VideoTIR: Accurate Understanding for Long Videos with Efficient Tool-Integrated Reasoning
  7. 2025TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action
  8. 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency