mlsanityData to 14 Oct 2026

SeGDeP: Semantic- and Geometric-Aware Decoupled Prompts for Reasoning Segmentation

arXiv 2609.08867 ↗First posted 8 Sep 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Reasoning segmentation converts an implicit linguistic conclusion into a precise mask, requiring both semantic identification and spatial grounding. Existing MLLM-segmenter interfaces either use a special trigger or compress both signals into one context, although they receive different supervision and fail differently. This coupling obscures whether a failure arises from target interpretation or from localization. We present SeGDeP, an explicit what-where interface. A semantic prompt branch and an independent geometric projection path transform resolved MLLM states into semantic features and a DETR-predicted box, which jointly condition a SAM 3 mask decoder. Training first aligns this executable interface, then uses group reward-decoupled policy optimization (GDPO) to balance format, box-IoU, and mask-IoU feedback. SeGDeP-4B reaches 82.7 average cIoU over eight RefCOCO-family splits and 66.0/59.6 gIoU on ReasonSeg val/test while adapting only 0.38% of Qwen3-VL parameters through LoRA. Controlled stage-wise ablations, gradient diagnostics, and prompt interventions further show that the two paths develop complementary semantic and geometric specialization rather than duplicating the same evidence.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 10 of its 44 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

10 of 44 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Think Before You Segment: High-Quality Reasoning Segmentation with GPT Chain of Thoughts10 Mar
  2. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
  3. 2023LISA++: An Improved Baseline for Reasoning Segmentation with Large Language Model28 Dec
  4. 2023Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillings3 May

Other references · 6

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  6. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DR2Seg: Decomposed Two-Stage Rollouts for Efficient Reasoning Segmentation in Multimodal Large Language Models
  2. 2026Seg-Agent: Test-Time Multimodal Reasoning for Training-Free Language-Guided Segmentation
  3. 2025NOVO: Bridging LLaVA and SAM with Visual-only Prompts for Reasoning Segmentation
  4. 2026DGSeg: Dynamic Gating of Semantic-Spatial Guided Predictions for Reasoning Segmentation
  5. 2026CR-Seg: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation
  6. 2026Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning
  7. 2026CoT-Seg: Rethinking Segmentation with Chain-of-Thought Reasoning and Self-Correction
  8. 2026SAM Meets VLM: Parameter-Decoupled Full-Parameter Training for Unified Medical Reasoning and Segmentation