VideoSSR: Video Self-Supervised Reinforcement Learning
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
Abstract (arXiv)
Reinforcement Learning with Verifiable Rewards (RLVR) has substantially advanced the video understanding capabilities of Multimodal Large Language Models (MLLMs). However, the rapid progress of MLLMs is outpacing the complexity of existing video datasets, while the manual annotation of new, high-quality data remains prohibitively expensive. This work investigates a pivotal question: Can the rich, intrinsic information within videos be harnessed to self-generate high-quality, verifiable training data? To investigate this, we introduce three self-supervised pretext tasks: Anomaly Grounding, Object Counting, and Temporal Jigsaw. We construct the Video Intrinsic Understanding Benchmark (VIUBench) to validate their difficulty, revealing that current state-of-the-art MLLMs struggle significantly on these tasks. Building upon these pretext tasks, we develop the VideoSSR-30K dataset and propose VideoSSR, a novel video self-supervised reinforcement learning framework for RLVR. Extensive experiments across 17 benchmarks, spanning four major video domains (General Video QA, Long Video QA, Temporal Grounding, and Complex Reasoning), demonstrate that VideoSSR consistently enhances model performance, yielding an average improvement of over 5%. These results establish VideoSSR as a potent foundational framework for developing more advanced video understanding in MLLMs. The code is available at https://github.com/lcqysl/VideoSSR.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 5 of its 7 references that are in the map. First posted on arXiv 9 Nov 2025.
Builds on
5 of 7 references.
References · 5
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
- 2020Self-supervised Video Representation Learning by Pace Predictioncited by 139
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
- 2025Fostering Video Reasoning via Next-Event Predictioncited by 18
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Modelscited by 19
- 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMscited by 4
- 2026MVP: Enhancing Video Large Language Models via Self-supervised Masked Video Predictioncited by 1
- 2026Video-MOPD: Multi-Teacher On-Policy Distillation for Video Understandingcited by 1
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcingcited by 0
- 2026EventLens: Event-Structure Reinforcement Learning for Video Understandingcited by 0
- 2026EventLens: Event-Structure Reinforcement Learning for Video Understanding12 Oct 2026
- 2026Video-MOPD: Multi-Teacher On-Policy Distillation for Video Understanding8 Sep 2026
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcing22 Jun 2026
- 2026Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMs1 May 2026
- 2026MVP: Enhancing Video Large Language Models via Self-supervised Masked Video Prediction7 Jan 2026
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Models30 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2026EasyVideoR1: Easier RL for Video Understanding
- 2026SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models
- 2026Video Models Can Reason with Verifiable Rewards
- 2026What Do Verifiable Rewards Teach Video-Language Models About Time? A Controlled Multi-Model Study
- 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoning
- 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
- 2026Frame Differential On-Policy Self-Distillation for Video Reasoning