mlsanityData to 14 Oct 2026

DR2Seg: Decomposed Two-Stage Rollouts for Efficient Reasoning Segmentation in Multimodal Large Language Models

arXiv 2601.09981 ↗First posted 15 Jan 2026cs.CVcited by 3

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Reasoning segmentation is an emerging vision-language task that requires reasoning over intricate text queries to precisely segment objects. However, existing methods typically suffer from overthinking, generating verbose reasoning chains that interfere with object localization in multimodal large language models (MLLMs). To address this issue, we propose DR2Seg, a self-rewarding framework that improves both reasoning efficiency and segmentation accuracy without requiring extra thinking supervision. DR2Seg employs a two-stage rollout strategy that decomposes reasoning segmentation into multimodal reasoning and referring segmentation. In the first stage, the model generates a self-contained description that explicitly specifies the target object. In the second stage, this description replaces the original complex query to verify its self-containment. Based on this design, two self-rewards are introduced to mitigate overthinking and the associated attention dispersion. Extensive experiments conducted on 3B and 7B variants of Qwen2.5-VL, as well as on both SAM2 and SAM3, demonstrate that DR2Seg consistently improves reasoning efficiency and overall segmentation accuracy.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 34 of its 36 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

34 of 36 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Self-Rewarding Vision-Language Model via Reasoning Decomposition27 Aug
  2. 2025LENS: Learning to Segment Anything with Unified Reinforced Reasoning19 Aug
  3. 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoning29 May
  4. 2025SAM-R1: Leveraging SAM for Reward Feedback in Multimodal Segmentation via Reinforcement Learning28 May
  5. 2025POPEN: Preference-Based Optimization and Ensemble for LVLM-Based Reasoning Segmentation1 Apr
  6. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
  7. 2024CoReS: Orchestrating the Dance of Reasoning and Segmentation8 Apr
  8. 2023PixelLM: Pixel Reasoning with Large Multimodal Model4 Dec

Other references · 26

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Segment Anythingcited by 8,234
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  7. 2016Modeling Context in Referring Expressionscited by 1,063
  8. 2025SAM 3: Segment Anything with Conceptscited by 906
  9. 2024Self-Rewarding Language Modelscited by 681
  10. 2020Image Segmentation Using Deep Learning: A Surveycited by 660
  11. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
  12. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
14 more
  1. 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
  2. 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 240
  3. 2025Learning to Reason without External Rewardscited by 210
  4. 2023LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmarkcited by 169
  5. 2025Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domainscited by 156
  6. 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 148
  7. 2024Calibrated Self-Rewarding Vision Language Modelscited by 78
  8. 2025Confidence Is All You Need: Few-Shot RL Fine-Tuning of Language Modelscited by 62
  9. 2023PerceptionGPT: Effectively Fusing Visual Perception into LLMcited by 59
  10. 2025Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systemscited by 51
  11. 2025Post-Training Large Language Models via Reinforcement Learning from Self-Feedbackcited by 15
  12. 2025RLSR: Reinforcement Learning from Self Rewardcited by 14
  13. 2025Reasoning Segmentation for Images and Videos: A Surveycited by 12
  14. 2025Policy Learning from Large Vision-Language Model Feedback without Reward Modelingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Seg-Agent: Test-Time Multimodal Reasoning for Training-Free Language-Guided Segmentation
  2. 2026Skip the Talk, Re-Focus on Vision: Latent Reasoning for Reasoning Segmentation in Multimodal Large Language Models
  3. 2026Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning
  4. 2026Seg-ReSearch: Segmentation with Interleaved Reasoning and External Search
  5. 2025Think Before You Segment: High-Quality Reasoning Segmentation with GPT Chain of Thoughts
  6. 2024LLM-Seg: Bridging Image Segmentation and Large Language Model Reasoning
  7. 2023LISA: Reasoning Segmentation via Large Language Model
  8. 2026DGSeg: Dynamic Gating of Semantic-Spatial Guided Predictions for Reasoning Segmentation