ReVSeg: Incentivizing the Reasoning Chain for Video Segmentation with Reinforcement Learning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Reasoning-centric video object segmentation is an inherently complex task: the query often refers to dynamics, causality, and temporal interactions, rather than static appearances. Yet existing solutions generally collapse these factors into simplified reasoning with latent embeddings, rendering the reasoning chain opaque and essentially intractable. We therefore adopt an explicit decomposition perspective and introduce ReVSeg, which executes reasoning as sequential decisions in the native interface of pretrained vision language models (VLMs). Rather than folding all reasoning into a single-step prediction, ReVSeg executes three explicit operations -- semantics interpretation, temporal evidence selection, and spatial grounding -- aligning pretrained capabilities. We further employ reinforcement learning to optimize the multi-step reasoning chain, enabling the model to self-refine its decision quality from outcome-driven signals. Experimental results demonstrate that ReVSeg attains state-of-the-art performances on standard video object segmentation benchmarks and yields interpretable reasoning trajectories. Project page is available at https://clementine24.github.io/ReVSeg/ .
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 55 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
27 of 55 references.
Closest ancestors · 13
Same direction, newest first
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025Grounded Reinforcement Learning for Visual Reasoning29 May
- 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Use25 May
- 2025CoT-RVS: Zero-Shot Chain-of-Thought Reasoning Segmentation for Videos24 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025VisionReasoner: Unified Reasoning-Integrated Visual Perception via Reinforcement Learning17 May
- 2025Skywork R1V2: Multimodal Hybrid Reinforcement Learning for Reasoning23 Apr
- 2025Kimi-VL Technical Report10 Apr
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
1 more
- 2023Tracking with Human-Intent Reasoning29 Dec
Other references · 14
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025Gemma 3 Technical Reportcited by 1,686
- 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
- 2016Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Modelscited by 299
- 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 120
- 2021SeqFormer: Sequential Transformer for Video Instance Segmentationcited by 98
2 more
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026AgentRVOS: Reasoning over Object Tracks for Zero-Shot Referring Video Object Segmentationcited by 2
- 2026The 1st Winner for 5th PVUW MeViS-Text Challenge: Strong MLLMs Meet SAM3 for Referring Video Object Segmentationcited by 1
- 2026VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentationcited by 0
- 2026VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentation5 Jun 2026
- 2026The 1st Winner for 5th PVUW MeViS-Text Challenge: Strong MLLMs Meet SAM3 for Referring Video Object Segmentation1 Apr 2026
- 2026AgentRVOS: Reasoning over Object Tracks for Zero-Shot Referring Video Object Segmentation24 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025VideoSeg-R1:Reasoning Video Object Segmentation via Reinforcement Learning
- 2025Reinforcing Video Reasoning Segmentation to Think Before It Segments
- 2026Seg-ReSearch: Segmentation with Interleaved Reasoning and External Search
- 2025Seg-R1: Segmentation Can Be Surprisingly Simple with Reinforcement Learning
- 2026RCoT-Seg: Reinforced Chain-of-Thought for Video Reasoning and Segmentation
- 2026Chain-of-Glimpse: Search-Guided Progressive Object-Grounded Reasoning for Video Understanding
- 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoning
- 2025REVISOR: Beyond Textual Reflection, Towards Multimodal Introspective Reasoning in Long-Form Video Understanding