mlsanityData to 13 Oct 2026

Semantic-Spatial Discriminability Enhancement for Generalized Visual Grounding

arXiv 2608.30233 ↗First posted 31 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Generalized Visual Grounding (GVG) task aims to localize targets in an image based on referring expressions, extends the classical visual grounding paradigm by integrating multi-target and non-target scenarios. Previous methods typically rely on global semantic matching or coarse-grained region interactions for localization, where the discriminative cues are primarily derived from sentence-level semantics or regional context. In complex multi-target scenarios, such approaches tend to confuse visually similar targets, making it difficult to establish stable instance-level decision boundaries. To address these limitations, this paper proposes a novel Semantic-Spatial Discriminability Enhancement (SSDE) framework for generalized visual grounding, which aims to enhance the discriminative ability on fine-grained semantics and spatial localization, improving both cross-modal understanding and instance-level grounding. Specifically, to enhance the semantic discriminability of query representations at the fine-grained level, we propose a Semantic Discriminability Enhancement (SeDE) module, which leverages spatially guided cross-attention to disentangle fine-grained target-relevant visual attributes and integrates them with the textual subject semantics. Furthermore, to strengthen the spatial discriminability of the referred targets, we introduce a Spatial Discriminability Enhancement (SpDE) module, which models an instance center density map to characterize the spatial distribution of targets, and explicitly constructs instance separation structures in the spatial domain by employing them as an auxiliary supervision signal. Extensive experiments show that SSDE achieves superior performance on ten datasets across both classic and generalized visual grounding tasks.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 50 of its 70 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

50 of 70 references.

References · 50

  1. 2017Attention Is All You Needcited by 60,106
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,072
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
  6. 2023Segment Anythingcited by 8,195
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
  8. 2020End-to-End Object Detection with Transformerscited by 7,396
  9. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,299
  10. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,344
  11. 2016Modeling Context in Referring Expressionscited by 1,057
  12. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 898
38 more
  1. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 898
  2. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 815
  3. 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 724
  4. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 448
  5. 2018MAttNet: Modular Attention Network for Referring Expression Comprehensioncited by 430
  6. 2021TransVG: End-to-End Visual Grounding with Transformerscited by 269
  7. 2016Modeling Context Between Objects for Referring Expression Understandingcited by 250
  8. 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 240
  9. 2019A Fast and Accurate One-Stage Approach to Visual Groundingcited by 194
  10. 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 147
  11. 2021Referring Transformer: A One-step Approach to Multi-task Visual Groundingcited by 143
  12. 2022SeqTR: A Simple yet Universal Network for Visual Groundingcited by 138
  13. 2020Improving One-stage Visual Grounding by Recursive Sub-query Constructioncited by 137
  14. 2022ReSTR: Convolution-free Referring Image Segmentation Using Transformerscited by 112
  15. 2021Encoder Fusion Network with Co-Attention Embedding for Referring Image Segmentationcited by 111
  16. 2019Learning to Compose and Reason with Language Tree Structures for Visual Groundingcited by 98
  17. 2019Improving Referring Expression Grounding with Cross-modal Attention-guided Erasingcited by 88
  18. 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 83
  19. 2017Grounding Referring Expressions in Images by Variational Contextcited by 82
  20. 2022Shifting More Attention to Visual Backbone: Query-modulated Refinement Networks for End-to-End Visual Groundingcited by 52
  21. 2020Ref-NMS: Breaking Proposal Bottlenecks in Two-Stage Referring Expression Groundingcited by 50
  22. 2018Rethinking Diversified and Discriminative Proposal Generation for Visual Groundingcited by 49
  23. 2023VLCounter: Text-aware Visual Representation for Zero-Shot Object Countingcited by 45
  24. 2023Language Adaptive Weight Generation for Multi-task Visual Groundingcited by 35
  25. 2019A Real-time Global Inference Network for One-stage Referring Expression Comprehensioncited by 32
  26. 2022Dynamic MDETR: A Dynamic Multimodal Transformer Decoder for Visual Groundingcited by 29
  27. 2023Parallel Vertex Diffusion for Unified Visual Groundingcited by 28
  28. 2024An Efficient and Effective Transformer Decoder-Based Framework for Multi-Task Visual Groundingcited by 21
  29. 2025Multi-task Visual Grounding with Coarse-to-Fine Consistency Constraintscited by 17
  30. 2024Visual Grounding with Multi-modal Conditional Adaptationcited by 12
  31. 2025Hierarchical Alignment-enhanced Adaptive Grounding Network for Generalized Referring Expression Comprehensioncited by 11
  32. 2024CoHD: A Counting-Aware Hierarchical Decoding Framework for Generalized Referring Expression Segmentationcited by 10
  33. 2025PropVG: End-to-End Proposal-Driven Visual Grounding with Multi-Granularity Discriminationcited by 10
  34. 2025SwimVG: Step-wise Multimodal Fusion and Adaption for Visual Groundingcited by 8
  35. 2025Improving Generalized Visual Grounding with Instance-aware Joint Learningcited by 8
  36. 2024MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehensioncited by 6
  37. 2025Latent Expression Generation for Referring Image Segmentation and Groundingcited by 6
  38. 2025ReMeREC: Relation-aware and Multi-entity Referring Expression Comprehensioncited by 4

Built on by

Not cited yet.