mlsanityData to 7 Oct 2026

PhraseCut: Language-based Image Segmentation in the Wild

arXiv 2008.01187 ↗First posted 3 Aug 2020cs.CVcited by 116

Not on the map. Why?

Abstract (arXiv)

We consider the problem of segmenting image regions given a natural language phrase, and study it on a novel dataset of 77,262 images and 345,486 phrase-region pairs. Our dataset is collected on top of the Visual Genome dataset and uses the existing annotations to generate a challenging set of referring phrases for which the corresponding regions are manually annotated. Phrases in our dataset correspond to multiple regions and describe a large number of object and stuff categories as well as their attributes such as color, shape, parts, and relationships with other entities in the image. Our experiments show that the scale and diversity of concepts in our dataset poses significant challenges to the existing state-of-the-art. We systematically handle the long-tail nature of these concepts and present a modular approach to combine category, attribute, and relationship cues that outperforms existing approaches.

Key facts. Cited by 116 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Aug 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 6; 2022: 13; 2023: 40; 2024: 15; 2025: 23; 2026: 19.

116 papers.

Sort:

By area:

  1. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
  2. 2021Image Segmentation Using Text and Image Promptscited by 509
  3. 2022GLIPv2: Unifying Localization and Vision-Language Understandingcited by 275
  4. 2023GRES: Generalized Referring Expression Segmentationcited by 252
  5. 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 233
  6. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
  7. 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
  8. 2023Towards Open Vocabulary Learning: A Surveycited by 165
  9. 2022SegCLIP: Patch Aggregation with Learnable Centers for Open-Vocabulary Semantic Segmentationcited by 162
  10. 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
  11. 2023PACO: Parts and Attributes of Common Objectscited by 146
  12. 2023Multi3DRefer: Grounding Text Description to Multiple 3D Objectscited by 142
38 more
  1. 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 121
  2. 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trendscited by 117
  3. 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 109
  4. 2021Learning to Predict Visual Attributes in the Wildcited by 95
  5. 2021Free-form Description Guided 3D Visual Graph Network for Object Grounding in Point Cloudcited by 81
  6. 2023Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentationcited by 76
  7. 2024GROUNDHOG: Grounding Large Language Models to Holistic Segmentationcited by 70
  8. 2023Beyond One-to-One: Rethinking the Referring Image Segmentationcited by 68
  9. 2023Zero-shot Referring Image Segmentation with Global-Local Context Featurescited by 61
  10. 2023RRSIS: Referring Remote Sensing Image Segmentationcited by 59
  11. 2023Aligning and Prompting Everything All at Once for Universal Visual Perceptioncited by 59
  12. 2023Contrastive Grouping with Transformer for Referring Image Segmentationcited by 54
  13. 2022Instance-Specific Feature Propagation for Referring Segmentationcited by 45
  14. 2023OvarNet: Towards Open-vocabulary Object Attribute Recognitioncited by 43
  15. 2023Described Object Detection: Liberating Object Detection with Flexible Expressionscited by 40
  16. 2023GREC: Generalized Referring Expression Comprehensioncited by 39
  17. 2024Multi-modal Instruction Tuned LLMs with Fine-grained Visual Perceptioncited by 39
  18. 2023Referring Image Segmentation Using Text Supervisioncited by 35
  19. 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 34
  20. 2023OV-PARTS: Towards Open-Vocabulary Part Segmentationcited by 31
  21. 2023Do GPTs Produce Less Literal Translations?cited by 30
  22. 2023LD-ZNet: A Latent Diffusion Approach for Text-Based Image Segmentationcited by 29
  23. 2023Exploring Transfer Learning in Medical Image Segmentation using Vision-Language Modelscited by 28
  24. 2023Temporal Collection and Distribution for Referring Video Object Segmentationcited by 27
  25. 2024Learning Visual Grounding from Generative Vision and Language Modelcited by 27
  26. 2024Cross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentationcited by 26
  27. 2025Know "No" Better: A Data-Driven Approach for Enhancing Negation Awareness in CLIPcited by 26
  28. 2025IteRPrimE: Zero-shot Referring Image Segmentation with Iterative Grad-CAM Refinement and Primary Word Emphasiscited by 26
  29. 2023Shatter and Gather: Learning Referring Image Segmentation with Text Supervisioncited by 25
  30. 2022Referring Image Mattingcited by 22
  31. 2025Multimodal Referring Segmentation: A Surveycited by 22
  32. 2021ClawCraneNet: Leveraging Object-level Relation for Text-based Video Segmentationcited by 21
  33. 2022Weakly-supervised segmentation of referring expressionscited by 21
  34. 2023RefEgo: Referring Expression Comprehension Dataset from First-Person Perception of Ego4Dcited by 21
  35. 2023Unveiling Parts Beyond Objects:Towards Finer-Granularity Referring Expression Segmentationcited by 21
  36. 2025Referring to Any Personcited by 20
  37. 2024Real-time Transformer-based Open-Vocabulary Detection with Efficient Fusion Headcited by 19
  38. 2025UniVG: A Generalist Diffusion Model for Unified Image Generation and Editingcited by 19

50 most cited of 116 All 116 (JSON)