mlsanityData to 7 Oct 2026

DGSeg: Dynamic Gating of Semantic-Spatial Guided Predictions for Reasoning Segmentation

arXiv 2607.04779 ↗First posted 6 Jul 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Reasoning segmentation aims to predict pixel-wise masks for targets given complex language queries. Existing approaches leverage Multimodal Large Language Models (MLLMs) for vision-language reasoning and generate intermediate target cues (e.g., points or boxes) to guide a segmentation model. However, compressing rich reasoning into sparse cues often introduces ambiguity and noise, preventing these cues from accurately preserving the reasoning intent. While multiple complementary cues can enrich target information, existing methods typically feed them jointly into a single segmentation process, allowing ambiguous or erroneous cues to affect the entire prediction. Therefore, we propose DGSeg, a reasoning segmentation framework that learns to fuse predictions guided by semantic and spatial cues. Specifically, the MLLM jointly reasons about both target identity and spatial location, producing complementary semantic and spatial cues that are fed into separate segmentation branches. Their predictions are adaptively integrated by a lightweight dynamic gating module trained with relative branch-quality supervision to suppress noisy or conflicting regions. Extensive experiments demonstrate that DGSeg consistently outperforms strong baselines on multiple benchmarks and achieves 69.6% and 67.3% gIoU on the challenging ReasonSeg validation and test splits. Code is available at https://github.com/RZZeng/DGSeg.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 54 of its 60 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

54 of 60 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025RSAgent: Learning to Reason and Act for Text-Guided Segmentation via Multi-Turn Tool Invocations30 Dec
  2. 2025CoPRS: Learning Positional Prior from Chain-of-Thought for Reasoning Segmentation13 Oct
  3. 2025LENS: Learning to Segment Anything with Unified Reinforced Reasoning19 Aug
  4. 2025Seg-R1: Segmentation Can Be Surprisingly Simple with Reinforcement Learning27 Jun
  5. 2025RSVP: Reasoning Segmentation via Visual Prompting and Multi-modal Chain-of-Thought4 Jun
  6. 2025Argus Inspection: Do Multimodal Large Language Models Possess the Eye of Panoptes?3 Jun
  7. 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoning29 May
  8. 2025SAM-R1: Leveraging SAM for Reward Feedback in Multimodal Segmentation via Reinforcement Learning28 May
  9. 2025VisionReasoner: Unified Reasoning-Integrated Visual Perception via Reinforcement Learning17 May
  10. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
  11. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  12. 2024VISA: Reasoning Video Object Segmentation via Large Language Models16 Jul
4 more
  1. 2024CoReS: Orchestrating the Dance of Reasoning and Segmentation8 Apr
  2. 2023Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models5 Dec
  3. 2023PixelLM: Pixel Reasoning with Large Multimodal Model4 Dec
  4. 2023LISA: Reasoning Segmentation via Large Language Model1 Aug

Other references · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  6. 2023Segment Anythingcited by 8,158
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2020End-to-End Object Detection with Transformerscited by 7,384
  9. 2025Qwen2.5-VL Technical Reportcited by 5,418
  10. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  11. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  12. 2017Deep reinforcement learning from human preferencescited by 3,846
26 more
  1. 2023Qwen Technical Reportcited by 3,273
  2. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  4. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  5. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  6. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
  7. 2016Modeling Context in Referring Expressionscited by 1,054
  8. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  9. 2025SAM 3: Segment Anything with Conceptscited by 835
  10. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
  11. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 560
  12. 2023Segment Everything Everywhere All at Oncecited by 546
  13. 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
  14. 2023GRES: Generalized Referring Expression Segmentationcited by 252
  15. 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
  16. 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Groundingcited by 78
  17. 2024SAM4MLLM: Enhance Multi-Modal Large Language Model for Referring Expression Segmentationcited by 68
  18. 2025Analyzing and Boosting the Power of Fine-Grained Visual Recognition for Multi-modal Large Language Modelscited by 30
  19. 2025SegAgent: Exploring Pixel Understanding Capabilities in MLLMs by Imitating Human Annotator Trajectoriescited by 29
  20. 2024Language-driven Grasp Detectioncited by 26
  21. 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinementcited by 19
  22. 2025Reasoning Segmentation for Images and Videos: A Surveycited by 12
  23. 2023ForceSight: Text-Guided Mobile Manipulation with Visual-Force Goalscited by 8
  24. 2023Stable Segment Anything Modelcited by 6
  25. 2025Segmentation as A Plug-and-Play Capability for Frozen Multimodal LLMscited by 5
  26. 2024CoF: Coarse to Fine-Grained Image Understanding for Multi-modal Large Language Modelscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AnchorSeg: Language Grounded Query Banks for Reasoning Segmentation
  2. 2026CR-Seg: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation
  3. 2026DR2Seg: Decomposed Two-Stage Rollouts for Efficient Reasoning Segmentation in Multimodal Large Language Models
  4. 2026Seg-Agent: Test-Time Multimodal Reasoning for Training-Free Language-Guided Segmentation
  5. 2026Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning
  6. 2025Enhancing Spatial Reasoning in Multimodal Large Language Models through Reasoning-based Segmentation
  7. 2026SeGDeP: Semantic- and Geometric-Aware Decoupled Prompts for Reasoning Segmentation
  8. 2025Think Before You Segment: High-Quality Reasoning Segmentation with GPT Chain of Thoughts