mlsanityData to 14 Oct 2026

Reinforcing Video Reasoning Segmentation to Think Before It Segments

arXiv 2508.11538 ↗First posted 15 Aug 2025cs.CVcited by 15

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Video reasoning segmentation (VRS) endeavors to delineate referred objects in videos guided by implicit instructions that encapsulate human intent and temporal logic. Previous approaches leverage large vision language models (LVLMs) to encode object semantics into <SEG> tokens for mask prediction. However, this paradigm suffers from limited interpretability during inference and suboptimal performance due to inadequate spatiotemporal reasoning. Drawing inspiration from seminal breakthroughs in reinforcement learning, we introduce Veason-R1, a specialized LVLM for VRS that emphasizes structured reasoning in segmentation. Veason-R1 is trained through Group Relative Policy Optimization (GRPO) augmented with Chain-of-Thought (CoT) initialization. To begin with, we curate high-quality CoT training data to instill structured reasoning trajectories, bridging video-level semantics and frame-level spatial grounding, yielding the supervised fine-tuned model Veason-SFT. Subsequently, GRPO fine-tuning encourages efficient exploration of the reasoning space by optimizing reasoning chains. To this end, we incorporate a holistic reward mechanism that synergistically enhances spatial alignment and temporal consistency, bolstering keyframe localization and fine-grained grounding. Comprehensive empirical evaluations demonstrate that Veason-R1 achieves state-of-the-art performance on multiple benchmarks, surpassing prior art by significant margins (e.g., +1.3 J &F in ReVOS and +10.0 J &F in ReasonVOS), while exhibiting robustness to hallucinations (+8.8 R). Our code and model weights will be available at Veason-R1.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 45 references that are in the map. First posted on arXiv 15 Aug 2025.

Builds on

30 of 45 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025Improving the Reasoning of Multi-Image Grounding in MLLMs via Reinforcement Learning1 Jul
  2. 2025Seg-R1: Segmentation Can Be Surprisingly Simple with Reinforcement Learning27 Jun
  3. 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoning29 May
  4. 2025SAM-R1: Leveraging SAM for Reward Feedback in Multimodal Segmentation via Reinforcement Learning28 May
  5. 2025UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learning20 May
  6. 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPO19 May
  7. 2025VisionReasoner: Unified Reasoning-Integrated Visual Perception via Reinforcement Learning17 May
  8. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  9. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  10. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing13 Mar
  11. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
  12. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
3 more
  1. 2025The Devil is in Temporal Token: High Quality Video Reasoning Segmentation15 Jan
  2. 2024HyperSeg: Towards Universal Visual Segmentation with Large Language Model26 Nov
  3. 2024ViLLa: Video Reasoning Segmentation with Large Language Model18 Jul

Other references · 15

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  7. 2024OpenAI o1 System Cardcited by 1,244
  8. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  9. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
  10. 2025Seed1.5-VL Technical Reportcited by 373
  11. 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 159
  12. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
3 more
  1. 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectivescited by 122
  2. 2025Omni-R1: Reinforcement Learning for Omnimodal Reasoning via Two-System Collaborationcited by 41
  3. 2024InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Modelscited by 31

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 12.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025VideoSeg-R1:Reasoning Video Object Segmentation via Reinforcement Learning
  2. 2025ReVSeg: Incentivizing the Reasoning Chain for Video Segmentation with Reinforcement Learning
  3. 2026VIRST: Video-Instructed Reasoning Assistant for SpatioTemporal Segmentation
  4. 2025Reinforcing Video Reasoning with Focused Thinking
  5. 2026VisionCoach: Reinforcing Grounded Video Reasoning via Visual-Perception Prompting
  6. 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoning
  7. 2024VISA: Reasoning Video Object Segmentation via Large Language Models
  8. 2025Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learning