mlsanityData to 7 Oct 2026

Linguistic Query-Guided Mask Generation for Referring Image Segmentation

arXiv 2301.06429 ↗First posted 16 Jan 2023cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Referring image segmentation aims to segment the image region of interest according to the given language expression, which is a typical multi-modal task. Existing methods either adopt the pixel classification-based or the learnable query-based framework for mask generation, both of which are insufficient to deal with various text-image pairs with a fix number of parametric prototypes. In this work, we propose an end-to-end framework built on transformer to perform Linguistic query-Guided mask generation, dubbed LGFormer. It views the linguistic features as query to generate a specialized prototype for arbitrary input image-text pair, thus generating more consistent segmentation results. Moreover, we design several cross-modal interaction modules (eg, vision-language bidirectional attention module, VLBA) in both encoder and decoder to achieve better cross-modal alignment.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 38 of its 62 references that are in the map. First posted on arXiv 16 Jan 2023.

Builds on

38 of 62 references.

References · 38

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2017Mask R-CNNcited by 7,259
  7. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  8. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  9. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  10. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  11. 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
  12. 2016Modeling Context in Referring Expressionscited by 1,054
26 more
  1. 2018Dual Attention Network for Scene Segmentationcited by 1,001
  2. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 897
  3. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
  4. 2020MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformerscited by 355
  5. 2021CRIS: CLIP-Driven Referring Image Segmentationcited by 353
  6. 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
  7. 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 304
  8. 2019Cross-Modal Self-Attention Network for Referring Image Segmentationcited by 263
  9. 2016Segmentation from Natural Language Expressionscited by 257
  10. 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 239
  11. 2020Multi-task Collaborative Network for Joint Referring Expression Comprehension and Segmentationcited by 204
  12. 2022Rethinking Semantic Segmentation: A Prototype Viewcited by 140
  13. 2020Referring Image Segmentation via Cross-Modal Progressive Comprehensioncited by 131
  14. 2017Recurrent Multimodal Interaction for Referring Image Segmentationcited by 125
  15. 2022ReSTR: Convolution-free Referring Image Segmentation Using Transformerscited by 112
  16. 2021Encoder Fusion Network with Co-Attention Embedding for Referring Image Segmentationcited by 111
  17. 2022VLT: Vision-Language Transformer and Query Generation for Referring Segmentationcited by 110
  18. 2020Linguistic Structure Guided Context Modeling for Referring Image Segmentationcited by 102
  19. 2021Cross-Modal Progressive Comprehension for Referring Segmentationcited by 102
  20. 2021Locate then Segment: A Strong Pipeline for Referring Image Segmentationcited by 98
  21. 2018Dynamic Multimodal Instance Segmentation guided by natural language queriescited by 83
  22. 2017Language-Based Image Editing with Recurrent Attentive Modelscited by 53
  23. 2022Towards Robust Referring Image Segmentationcited by 49
  24. 2022CoupAlign: Coupling Word-Pixel with Sentence-Mask Alignments for Referring Image Segmentationcited by 28
  25. 2021MaIL: A Unified Mask-Image-Language Trimodal Network for Referring Image Segmentationcited by 14
  26. 2020Dual Convolutional LSTM Network for Referring Image Segmentationcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.

  1. 2025Multimodal Referring Segmentation: A Surveycited by 22
  2. 2024CoHD: A Counting-Aware Hierarchical Decoding Framework for Generalized Referring Expression Segmentationcited by 10
  3. 2025RESAnything: Attribute Prompting for Arbitrary Referring Segmentationcited by 4
  4. 2026Spatio-Semantic Expert Routing Architecture with Mixture-of-Experts for Referring Image Segmentationcited by 0