mlsanityData to 14 Oct 2026

VideoSSR: Video Self-Supervised Reinforcement Learning

arXiv 2511.06281 ↗First posted 9 Nov 2025cs.CVcited by 6

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

also in 1 more
Abstract (arXiv)

Reinforcement Learning with Verifiable Rewards (RLVR) has substantially advanced the video understanding capabilities of Multimodal Large Language Models (MLLMs). However, the rapid progress of MLLMs is outpacing the complexity of existing video datasets, while the manual annotation of new, high-quality data remains prohibitively expensive. This work investigates a pivotal question: Can the rich, intrinsic information within videos be harnessed to self-generate high-quality, verifiable training data? To investigate this, we introduce three self-supervised pretext tasks: Anomaly Grounding, Object Counting, and Temporal Jigsaw. We construct the Video Intrinsic Understanding Benchmark (VIUBench) to validate their difficulty, revealing that current state-of-the-art MLLMs struggle significantly on these tasks. Building upon these pretext tasks, we develop the VideoSSR-30K dataset and propose VideoSSR, a novel video self-supervised reinforcement learning framework for RLVR. Extensive experiments across 17 benchmarks, spanning four major video domains (General Video QA, Long Video QA, Temporal Grounding, and Complex Reasoning), demonstrate that VideoSSR consistently enhances model performance, yielding an average improvement of over 5%. These results establish VideoSSR as a potent foundational framework for developing more advanced video understanding in MLLMs. The code is available at https://github.com/lcqysl/VideoSSR.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 5 of its 7 references that are in the map. First posted on arXiv 9 Nov 2025.

Builds on

5 of 7 references.

References · 5

  1. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  2. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
  3. 2020Self-supervised Video Representation Learning by Pace Predictioncited by 139
  4. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
  5. 2025Fostering Video Reasoning via Next-Event Predictioncited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EasyVideoR1: Easier RL for Video Understanding
  2. 2026SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models
  3. 2026Video Models Can Reason with Verifiable Rewards
  4. 2026What Do Verifiable Rewards Teach Video-Language Models About Time? A Controlled Multi-Model Study
  5. 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoning
  6. 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
  7. 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
  8. 2026Frame Differential On-Policy Self-Distillation for Video Reasoning