mlsanityData to 7 Oct 2026

Linguistic Structure Guided Context Modeling for Referring Image Segmentation

arXiv 2010.00515 ↗First posted 1 Oct 2020cs.CV cs.CLcited by 102

Not on the map. Why?

Abstract (arXiv)

Referring image segmentation aims to predict the foreground mask of the object referred by a natural language sentence. Multimodal context of the sentence is crucial to distinguish the referent from the background. Existing methods either insufficiently or redundantly model the multimodal context. To tackle this problem, we propose a "gather-propagate-distribute" scheme to model multimodal context by cross-modal interaction and implement this scheme as a novel Linguistic Structure guided Context Modeling (LSCM) module. Our LSCM module builds a Dependency Parsing Tree suppressed Word Graph (DPT-WG) which guides all the words to include valid multimodal context of the sentence while excluding disturbing ones through three steps over the multimodal feature, i.e., gathering, constrained propagation and distributing. Extensive experiments on four benchmarks demonstrate that our method outperforms all the previous state-of-the-arts.

Key facts. Cited by 102 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 15; 2022: 17; 2023: 26; 2024: 21; 2025: 15; 2026: 8.

102 papers.

Sort:

By area:

  1. 2021CRIS: CLIP-Driven Referring Image Segmentationcited by 353
  2. 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
  3. 2023GRES: Generalized Referring Expression Segmentationcited by 252
  4. 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 239
  5. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
  6. 2022SeqTR: A Simple yet Universal Network for Visual Groundingcited by 138
  7. 2022ReSTR: Convolution-free Referring Image Segmentation Using Transformerscited by 112
  8. 2021Encoder Fusion Network with Co-Attention Embedding for Referring Image Segmentationcited by 111
  9. 2022VLT: Vision-Language Transformer and Query Generation for Referring Segmentationcited by 110
  10. 2021Locate then Segment: A Strong Pipeline for Referring Image Segmentationcited by 98
  11. 2021Reformulating HOI Detection as Adaptive Set Predictioncited by 95
  12. 2023SegVol: Universal and Interactive Volumetric Medical Image Segmentationcited by 86
38 more
  1. 2023Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentationcited by 76
  2. 2023Beyond One-to-One: Rethinking the Referring Image Segmentationcited by 68
  3. 2024SAM4MLLM: Enhance Multi-Modal Large Language Model for Referring Expression Segmentationcited by 68
  4. 2023Bridging Vision and Language Encoders: Parameter-Efficient Tuning for Referring Image Segmentationcited by 61
  5. 2025LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understandingcited by 57
  6. 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
  7. 2023Contrastive Grouping with Transformer for Referring Image Segmentationcited by 54
  8. 2023Hierarchical Open-vocabulary Universal Image Segmentationcited by 53
  9. 2022Language-Bridged Spatial-Temporal Interaction for Referring Video Object Segmentationcited by 50
  10. 2022Towards Robust Referring Image Segmentationcited by 49
  11. 2022Instance-Specific Feature Propagation for Referring Segmentationcited by 45
  12. 2022Local-Global Context Aware Transformer for Language-Guided Video Segmentationcited by 41
  13. 2023Mask Grounding for Referring Image Segmentationcited by 40
  14. 2024ReMamber: Referring Image Segmentation with Mamba Twistercited by 38
  15. 2025RemoteSAM: Towards Segment Anything for Earth Observationcited by 38
  16. 2023Multi-Modal Mutual Attention and Iterative Interaction for Referring Image Segmentationcited by 36
  17. 2023Referring Image Segmentation Using Text Supervisioncited by 35
  18. 2022Peekaboo: Text to Image Diffusion Models are Zero-Shot Segmentorscited by 34
  19. 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 34
  20. 2021Collaborative Spatial-Temporal Modeling for Language-Queried Video Actor Segmentationcited by 32
  21. 2023Universal Segmentation at Arbitrary Granularity with Language Instructioncited by 29
  22. 2022CoupAlign: Coupling Word-Pixel with Sentence-Mask Alignments for Referring Image Segmentationcited by 28
  23. 2023Parallel Vertex Diffusion for Unified Visual Groundingcited by 28
  24. 2021Panoptic Narrative Groundingcited by 27
  25. 2023Temporal Collection and Distribution for Referring Video Object Segmentationcited by 27
  26. 2024Cross-Modal Conditioned Reconstruction for Language-guided Medical Image Segmentationcited by 27
  27. 2024Cross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentationcited by 26
  28. 2023Shatter and Gather: Learning Referring Image Segmentation with Text Supervisioncited by 25
  29. 2023RefSAM: Efficiently Adapting Segmenting Anything Model for Referring Video Object Segmentationcited by 24
  30. 2024Exploring Fine-Grained Image-Text Alignment for Referring Remote Sensing Image Segmentationcited by 24
  31. 2022Entity-enhanced Adaptive Reconstruction Network for Weakly Supervised Referring Expression Groundingcited by 22
  32. 2023UniRef++: Segment Every Reference Object in Spatial and Temporal Spacescited by 22
  33. 2025RSRefSeg: Referring Remote Sensing Image Segmentation with Foundation Modelscited by 22
  34. 2025Pixel-SAIL: Single Transformer For Pixel-Grounded Understandingcited by 22
  35. 2025Multimodal Referring Segmentation: A Surveycited by 22
  36. 2021ClawCraneNet: Leveraging Object-level Relation for Text-based Video Segmentationcited by 21
  37. 2024Cross-aware Early Fusion with Stage-divided Vision and Language Transformer Encoders for Referring Image Segmentationcited by 21
  38. 2023Extending CLIP's Image-Text Alignment to Referring Image Segmentationcited by 19

50 most cited of 102 All 102 (JSON)