Semantic-Spatial Discriminability Enhancement for Generalized Visual Grounding
Not on the map. Why?
Abstract (arXiv)
Generalized Visual Grounding (GVG) task aims to localize targets in an image based on referring expressions, extends the classical visual grounding paradigm by integrating multi-target and non-target scenarios. Previous methods typically rely on global semantic matching or coarse-grained region interactions for localization, where the discriminative cues are primarily derived from sentence-level semantics or regional context. In complex multi-target scenarios, such approaches tend to confuse visually similar targets, making it difficult to establish stable instance-level decision boundaries. To address these limitations, this paper proposes a novel Semantic-Spatial Discriminability Enhancement (SSDE) framework for generalized visual grounding, which aims to enhance the discriminative ability on fine-grained semantics and spatial localization, improving both cross-modal understanding and instance-level grounding. Specifically, to enhance the semantic discriminability of query representations at the fine-grained level, we propose a Semantic Discriminability Enhancement (SeDE) module, which leverages spatially guided cross-attention to disentangle fine-grained target-relevant visual attributes and integrates them with the textual subject semantics. Furthermore, to strengthen the spatial discriminability of the referred targets, we introduce a Spatial Discriminability Enhancement (SpDE) module, which models an instance center density map to characterize the spatial distribution of targets, and explicitly constructs instance separation structures in the spatial domain by employing them as an auxiliary supervision signal. Extensive experiments show that SSDE achieves superior performance on ten datasets across both classic and generalized visual grounding tasks.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 50 of its 70 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
50 of 70 references.
References · 50
- 2017Attention Is All You Needcited by 60,106
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,072
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
- 2023Segment Anythingcited by 8,195
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
- 2020End-to-End Object Detection with Transformerscited by 7,396
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,299
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,344
- 2016Modeling Context in Referring Expressionscited by 1,057
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 898
38 more
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 898
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 815
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 724
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 448
- 2018MAttNet: Modular Attention Network for Referring Expression Comprehensioncited by 430
- 2021TransVG: End-to-End Visual Grounding with Transformerscited by 269
- 2016Modeling Context Between Objects for Referring Expression Understandingcited by 250
- 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 240
- 2019A Fast and Accurate One-Stage Approach to Visual Groundingcited by 194
- 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 147
- 2021Referring Transformer: A One-step Approach to Multi-task Visual Groundingcited by 143
- 2022SeqTR: A Simple yet Universal Network for Visual Groundingcited by 138
- 2020Improving One-stage Visual Grounding by Recursive Sub-query Constructioncited by 137
- 2022ReSTR: Convolution-free Referring Image Segmentation Using Transformerscited by 112
- 2021Encoder Fusion Network with Co-Attention Embedding for Referring Image Segmentationcited by 111
- 2019Learning to Compose and Reason with Language Tree Structures for Visual Groundingcited by 98
- 2019Improving Referring Expression Grounding with Cross-modal Attention-guided Erasingcited by 88
- 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 83
- 2017Grounding Referring Expressions in Images by Variational Contextcited by 82
- 2022Shifting More Attention to Visual Backbone: Query-modulated Refinement Networks for End-to-End Visual Groundingcited by 52
- 2020Ref-NMS: Breaking Proposal Bottlenecks in Two-Stage Referring Expression Groundingcited by 50
- 2018Rethinking Diversified and Discriminative Proposal Generation for Visual Groundingcited by 49
- 2023VLCounter: Text-aware Visual Representation for Zero-Shot Object Countingcited by 45
- 2023Language Adaptive Weight Generation for Multi-task Visual Groundingcited by 35
- 2019A Real-time Global Inference Network for One-stage Referring Expression Comprehensioncited by 32
- 2022Dynamic MDETR: A Dynamic Multimodal Transformer Decoder for Visual Groundingcited by 29
- 2023Parallel Vertex Diffusion for Unified Visual Groundingcited by 28
- 2024An Efficient and Effective Transformer Decoder-Based Framework for Multi-Task Visual Groundingcited by 21
- 2025Multi-task Visual Grounding with Coarse-to-Fine Consistency Constraintscited by 17
- 2024Visual Grounding with Multi-modal Conditional Adaptationcited by 12
- 2025Hierarchical Alignment-enhanced Adaptive Grounding Network for Generalized Referring Expression Comprehensioncited by 11
- 2024CoHD: A Counting-Aware Hierarchical Decoding Framework for Generalized Referring Expression Segmentationcited by 10
- 2025PropVG: End-to-End Proposal-Driven Visual Grounding with Multi-Granularity Discriminationcited by 10
- 2025SwimVG: Step-wise Multimodal Fusion and Adaption for Visual Groundingcited by 8
- 2025Improving Generalized Visual Grounding with Instance-aware Joint Learningcited by 8
- 2024MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehensioncited by 6
- 2025Latent Expression Generation for Referring Image Segmentation and Groundingcited by 6
- 2025ReMeREC: Relation-aware and Multi-entity Referring Expression Comprehensioncited by 4
Built on by
Not cited yet.