DGSeg: Dynamic Gating of Semantic-Spatial Guided Predictions for Reasoning Segmentation
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Reasoning segmentation aims to predict pixel-wise masks for targets given complex language queries. Existing approaches leverage Multimodal Large Language Models (MLLMs) for vision-language reasoning and generate intermediate target cues (e.g., points or boxes) to guide a segmentation model. However, compressing rich reasoning into sparse cues often introduces ambiguity and noise, preventing these cues from accurately preserving the reasoning intent. While multiple complementary cues can enrich target information, existing methods typically feed them jointly into a single segmentation process, allowing ambiguous or erroneous cues to affect the entire prediction. Therefore, we propose DGSeg, a reasoning segmentation framework that learns to fuse predictions guided by semantic and spatial cues. Specifically, the MLLM jointly reasons about both target identity and spatial location, producing complementary semantic and spatial cues that are fed into separate segmentation branches. Their predictions are adaptively integrated by a lightweight dynamic gating module trained with relative branch-quality supervision to suppress noisy or conflicting regions. Extensive experiments demonstrate that DGSeg consistently outperforms strong baselines on multiple benchmarks and achieves 69.6% and 67.3% gIoU on the challenging ReasonSeg validation and test splits. Code is available at https://github.com/RZZeng/DGSeg.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 54 of its 60 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
54 of 60 references.
Closest ancestors · 16
Same direction, newest first
- 2025RSAgent: Learning to Reason and Act for Text-Guided Segmentation via Multi-Turn Tool Invocations30 Dec
- 2025CoPRS: Learning Positional Prior from Chain-of-Thought for Reasoning Segmentation13 Oct
- 2025LENS: Learning to Segment Anything with Unified Reinforced Reasoning19 Aug
- 2025Seg-R1: Segmentation Can Be Surprisingly Simple with Reinforcement Learning27 Jun
- 2025RSVP: Reasoning Segmentation via Visual Prompting and Multi-modal Chain-of-Thought4 Jun
- 2025Argus Inspection: Do Multimodal Large Language Models Possess the Eye of Panoptes?3 Jun
- 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoning29 May
- 2025SAM-R1: Leveraging SAM for Reward Feedback in Multimodal Segmentation via Reinforcement Learning28 May
- 2025VisionReasoner: Unified Reasoning-Integrated Visual Perception via Reinforcement Learning17 May
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024VISA: Reasoning Video Object Segmentation via Large Language Models16 Jul
4 more
- 2024CoReS: Orchestrating the Dance of Reasoning and Segmentation8 Apr
- 2023Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models5 Dec
- 2023PixelLM: Pixel Reasoning with Large Multimodal Model4 Dec
- 2023LISA: Reasoning Segmentation via Large Language Model1 Aug
Other references · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2017Deep reinforcement learning from human preferencescited by 3,846
26 more
- 2023Qwen Technical Reportcited by 3,273
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 560
- 2023Segment Everything Everywhere All at Oncecited by 546
- 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
- 2023GRES: Generalized Referring Expression Segmentationcited by 252
- 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
- 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Groundingcited by 78
- 2024SAM4MLLM: Enhance Multi-Modal Large Language Model for Referring Expression Segmentationcited by 68
- 2025Analyzing and Boosting the Power of Fine-Grained Visual Recognition for Multi-modal Large Language Modelscited by 30
- 2025SegAgent: Exploring Pixel Understanding Capabilities in MLLMs by Imitating Human Annotator Trajectoriescited by 29
- 2024Language-driven Grasp Detectioncited by 26
- 2025SAMRefiner: Taming Segment Anything Model for Universal Mask Refinementcited by 19
- 2025Reasoning Segmentation for Images and Videos: A Surveycited by 12
- 2023ForceSight: Text-Guided Mobile Manipulation with Visual-Force Goalscited by 8
- 2023Stable Segment Anything Modelcited by 6
- 2025Segmentation as A Plug-and-Play Capability for Frozen Multimodal LLMscited by 5
- 2024CoF: Coarse to Fine-Grained Image Understanding for Multi-modal Large Language Modelscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AnchorSeg: Language Grounded Query Banks for Reasoning Segmentation
- 2026CR-Seg: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation
- 2026DR2Seg: Decomposed Two-Stage Rollouts for Efficient Reasoning Segmentation in Multimodal Large Language Models
- 2026Seg-Agent: Test-Time Multimodal Reasoning for Training-Free Language-Guided Segmentation
- 2026Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning
- 2025Enhancing Spatial Reasoning in Multimodal Large Language Models through Reasoning-based Segmentation
- 2026SeGDeP: Semantic- and Geometric-Aware Decoupled Prompts for Reasoning Segmentation
- 2025Think Before You Segment: High-Quality Reasoning Segmentation with GPT Chain of Thoughts