mlsanityData to 14 Oct 2026

ViSS-R1: Self-Supervised Reinforcement Video Reasoning

arXiv 2511.13054 ↗First posted 17 Nov 2025cs.CVcited by 6

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Complex video reasoning remains a significant challenge for Multimodal Large Language Models (MLLMs), as current R1-based methodologies often prioritize text-centric reasoning derived from text-based and image-based developments. In video tasks, such strategies frequently underutilize rich visual information, leading to potential shortcut learning and increased susceptibility to hallucination. To foster a more robust, visual-centric video understanding, we start by introducing a novel self-supervised reinforcement learning GRPO algorithm (Pretext-GRPO) within the standard R1 pipeline, in which positive rewards are assigned for correctly solving pretext tasks on transformed visual inputs, which makes the model to non-trivially process the visual information. Building on the effectiveness of Pretext-GRPO, we further propose the ViSS-R1 framework, which streamlines and integrates pretext-task-based self-supervised learning directly into the MLLM's R1 post-training paradigm. Instead of relying solely on sparse visual cues, our framework compels models to reason about transformed visual input by simultaneously processing both pretext questions (concerning transformations) and true user queries. This necessitates identifying the applied transformation and reconstructing the original video to formulate accurate final answers. Comprehensive evaluations on six widely-used video reasoning and understanding benchmarks demonstrate the effectiveness and superiority of our Pretext-GRPO and ViSS-R1 for complex video reasoning. Our codes and models will be publicly available.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 74 references that are in the map. First posted on arXiv 17 Nov 2025.

Builds on

37 of 74 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025Visual Jigsaw Post-Training Improves MLLMs29 Sep
  2. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning6 Aug
  3. 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency2 Jun
  4. 2025Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzles29 May
  5. 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Models24 May
  6. 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning18 May
  7. 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning13 Apr
  8. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  9. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  10. 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Models26 Mar
  11. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
  12. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
3 more
  1. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  2. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  3. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar

Other references · 22

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  8. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
  9. 2024OpenAI o1 System Cardcited by 1,244
  10. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  11. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
  12. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
10 more
  1. 2024Long Context Transfer from Language to Visioncited by 515
  2. 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
  3. 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 322
  4. 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 309
  5. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
  6. 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 291
  7. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
  8. 2024Frame-Voyager: Learning to Query Frames for Video Large Language Modelscited by 83
  9. 2018Self-Supervised Spatiotemporal Feature Learning via Video Rotation Predictioncited by 71
  10. 2025Unhackable Temporal Rewarding for Scalable Video MLLMscited by 33

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025OneThinker: All-in-one Reasoning Model for Image and Video
  2. 2025Reinforcing Video Reasoning with Focused Thinking
  3. 2025VideoSSR: Video Self-Supervised Reinforcement Learning
  4. 2025Constructing and Interpreting Digital Twin Representations for Visual Reasoning via Reinforcement Learning
  5. 2026Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs
  6. 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Tasks
  7. 2026SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models
  8. 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1