mlsanityData to 7 Oct 2026

Transformer-based Spatial Grounding: A Comprehensive Survey

arXiv 2507.12739 ↗First posted 17 Jul 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Spatial grounding, the process of associating natural language expressions with corresponding image regions, has rapidly advanced due to the introduction of transformer-based models, significantly enhancing multimodal representation and cross-modal alignment. Despite this progress, the field lacks a comprehensive synthesis of current methodologies, dataset usage, evaluation metrics, and industrial applicability. This paper presents a systematic literature review of transformer-based spatial grounding approaches from 2018 to 2025. Our analysis identifies dominant model architectures, prevalent datasets, and widely adopted evaluation metrics, alongside highlighting key methodological trends and best practices. This study provides essential insights and structured guidance for researchers and practitioners, facilitating the development of robust, reliable, and industry-ready transformer-based spatial grounding models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 44 references that are in the map. First posted on arXiv 17 Jul 2025.

Builds on

22 of 44 references.

References · 22

  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  2. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  3. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  4. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  5. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 447
  6. 2021TransVG: End-to-End Visual Grounding with Transformerscited by 269
  7. 2021Referring Transformer: A One-step Approach to Multi-task Visual Groundingcited by 143
  8. 2023Grounding Language Models to Images for Multimodal Inputs and Outputscited by 129
  9. 2021Bottom Up Top Down Detection Transformers for Language Grounding in Images and Point Cloudscited by 128
  10. 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 121
  11. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 98
  12. 2018Grounding Visual Explanationscited by 92
10 more
  1. 2019TIGEr: Text-to-Image Grounding for Image Caption Evaluationcited by 58
  2. 2024Toward Visual Grounding: A Surveycited by 52
  3. 2022TransVG++: End-to-End Visual Grounding with Language Conditioned Vision Transformercited by 41
  4. 2024Q-Ground: Image Quality Grounding with Large Multi-modality Modelscited by 30
  5. 2022Collaborative Transformers for Grounded Situation Recognitioncited by 19
  6. 2021Word2Pix: Word to Pixel Cross Attention Transformer in Visual Groundingcited by 16
  7. 2018Unsupervised Textual Grounding: Linking Words to Image Conceptscited by 13
  8. 2022SiRi: A Simple Selective Retraining Mechanism for Transformer-based Visual Groundingcited by 12
  9. 2024Visual Grounding with Multi-modal Conditional Adaptationcited by 12
  10. 2021Multimodal Incremental Transformer with Visual Grounding for Visual Dialogue Generationcited by 11

Built on by

Not cited yet.