ViSS-R1: Self-Supervised Reinforcement Video Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Complex video reasoning remains a significant challenge for Multimodal Large Language Models (MLLMs), as current R1-based methodologies often prioritize text-centric reasoning derived from text-based and image-based developments. In video tasks, such strategies frequently underutilize rich visual information, leading to potential shortcut learning and increased susceptibility to hallucination. To foster a more robust, visual-centric video understanding, we start by introducing a novel self-supervised reinforcement learning GRPO algorithm (Pretext-GRPO) within the standard R1 pipeline, in which positive rewards are assigned for correctly solving pretext tasks on transformed visual inputs, which makes the model to non-trivially process the visual information. Building on the effectiveness of Pretext-GRPO, we further propose the ViSS-R1 framework, which streamlines and integrates pretext-task-based self-supervised learning directly into the MLLM's R1 post-training paradigm. Instead of relying solely on sparse visual cues, our framework compels models to reason about transformed visual input by simultaneously processing both pretext questions (concerning transformations) and true user queries. This necessitates identifying the applied transformation and reconstructing the original video to formulate accurate final answers. Comprehensive evaluations on six widely-used video reasoning and understanding benchmarks demonstrate the effectiveness and superiority of our Pretext-GRPO and ViSS-R1 for complex video reasoning. Our codes and models will be publicly available.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 74 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
37 of 74 references.
Closest ancestors · 15
Same direction, newest first
- 2025Visual Jigsaw Post-Training Improves MLLMs29 Sep
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning6 Aug
- 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency2 Jun
- 2025Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzles29 May
- 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Models24 May
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
- 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning13 Apr
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Models26 Mar
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
3 more
Other references · 22
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
- 2024OpenAI o1 System Cardcited by 1,244
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
10 more
- 2024Long Context Transfer from Language to Visioncited by 515
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
- 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 322
- 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 309
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 291
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
- 2024Frame-Voyager: Learning to Query Frames for Video Large Language Modelscited by 83
- 2018Self-Supervised Spatiotemporal Feature Learning via Video Rotation Predictioncited by 71
- 2025Unhackable Temporal Rewarding for Scalable Video MLLMscited by 33
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shapingcited by 3
- 2026Self-Evolving Spatial Reasoning in Vision Language Models via Geometric Logic Consistencycited by 3
- 2026I Seek You in Videos: Identity-Conditioned Queries for Person-Centric Video Reasoningcited by 1
- 2026Decompose and Transfer: CoT-Prompting Enhanced Alignment for Open-Vocabulary Temporal Action Detectioncited by 0
- 2026EventLens: Event-Structure Reinforcement Learning for Video Understandingcited by 0
- 2026Meta-Video: Efficient Standardized Evaluation for Video Understandingcited by 0
- 2026Meta-Video: Efficient Standardized Evaluation for Video Understanding13 Oct 2026
- 2026EventLens: Event-Structure Reinforcement Learning for Video Understanding12 Oct 2026
- 2026I Seek You in Videos: Identity-Conditioned Queries for Person-Centric Video Reasoning7 Aug 2026
- 2026Self-Evolving Spatial Reasoning in Vision Language Models via Geometric Logic Consistency18 May 2026
- 2026Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shaping11 May 2026
- 2026Decompose and Transfer: CoT-Prompting Enhanced Alignment for Open-Vocabulary Temporal Action Detection25 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025OneThinker: All-in-one Reasoning Model for Image and Video
- 2025Reinforcing Video Reasoning with Focused Thinking
- 2025VideoSSR: Video Self-Supervised Reinforcement Learning
- 2025Constructing and Interpreting Digital Twin Representations for Visual Reasoning via Reinforcement Learning
- 2026Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Tasks
- 2026SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models
- 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1