DR2Seg: Decomposed Two-Stage Rollouts for Efficient Reasoning Segmentation in Multimodal Large Language Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Reasoning segmentation is an emerging vision-language task that requires reasoning over intricate text queries to precisely segment objects. However, existing methods typically suffer from overthinking, generating verbose reasoning chains that interfere with object localization in multimodal large language models (MLLMs). To address this issue, we propose DR2Seg, a self-rewarding framework that improves both reasoning efficiency and segmentation accuracy without requiring extra thinking supervision. DR2Seg employs a two-stage rollout strategy that decomposes reasoning segmentation into multimodal reasoning and referring segmentation. In the first stage, the model generates a self-contained description that explicitly specifies the target object. In the second stage, this description replaces the original complex query to verify its self-containment. Based on this design, two self-rewards are introduced to mitigate overthinking and the associated attention dispersion. Extensive experiments conducted on 3B and 7B variants of Qwen2.5-VL, as well as on both SAM2 and SAM3, demonstrate that DR2Seg consistently improves reasoning efficiency and overall segmentation accuracy.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 34 of its 36 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
34 of 36 references.
Closest ancestors · 8
Same direction, newest first
- 2025Self-Rewarding Vision-Language Model via Reasoning Decomposition27 Aug
- 2025LENS: Learning to Segment Anything with Unified Reinforced Reasoning19 Aug
- 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoning29 May
- 2025SAM-R1: Leveraging SAM for Reward Feedback in Multimodal Segmentation via Reinforcement Learning28 May
- 2025POPEN: Preference-Based Optimization and Ensemble for LVLM-Based Reasoning Segmentation1 Apr
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
- 2024CoReS: Orchestrating the Dance of Reasoning and Segmentation8 Apr
- 2023PixelLM: Pixel Reasoning with Large Multimodal Model4 Dec
Other references · 26
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Segment Anythingcited by 8,234
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2016Modeling Context in Referring Expressionscited by 1,063
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2024Self-Rewarding Language Modelscited by 681
- 2020Image Segmentation Using Deep Learning: A Surveycited by 660
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
14 more
- 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
- 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 240
- 2025Learning to Reason without External Rewardscited by 210
- 2023LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmarkcited by 169
- 2025Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domainscited by 156
- 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 148
- 2024Calibrated Self-Rewarding Vision Language Modelscited by 78
- 2025Confidence Is All You Need: Few-Shot RL Fine-Tuning of Language Modelscited by 62
- 2023PerceptionGPT: Effectively Fusing Visual Perception into LLMcited by 59
- 2025Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systemscited by 51
- 2025Post-Training Large Language Models via Reinforcement Learning from Self-Feedbackcited by 15
- 2025RLSR: Reinforcement Learning from Self Rewardcited by 14
- 2025Reasoning Segmentation for Images and Videos: A Surveycited by 12
- 2025Policy Learning from Large Vision-Language Model Feedback without Reward Modelingcited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Seg-Agent: Test-Time Multimodal Reasoning for Training-Free Language-Guided Segmentation
- 2026Skip the Talk, Re-Focus on Vision: Latent Reasoning for Reasoning Segmentation in Multimodal Large Language Models
- 2026Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning
- 2026Seg-ReSearch: Segmentation with Interleaved Reasoning and External Search
- 2025Think Before You Segment: High-Quality Reasoning Segmentation with GPT Chain of Thoughts
- 2024LLM-Seg: Bridging Image Segmentation and Large Language Model Reasoning
- 2023LISA: Reasoning Segmentation via Large Language Model
- 2026DGSeg: Dynamic Gating of Semantic-Spatial Guided Predictions for Reasoning Segmentation