mlsanityData to 7 Oct 2026

In Defense of Lazy Visual Grounding for Open-Vocabulary Semantic Segmentation

arXiv 2408.04961 ↗First posted 9 Aug 2024cs.CVcited by 38

Not on the map. Why?

Abstract (arXiv)

We present lazy visual grounding, a two-stage approach of unsupervised object mask discovery followed by object grounding, for open-vocabulary semantic segmentation. Plenty of the previous art casts this task as pixel-to-text classification without object-level comprehension, leveraging the image-to-text classification capability of pretrained vision-and-language models. We argue that visual objects are distinguishable without the prior text information as segmentation is essentially a vision task. Lazy visual grounding first discovers object masks covering an image with iterative Normalized cuts and then later assigns text on the discovered objects in a late interaction manner. Our model requires no additional training yet shows great performance on five public datasets: Pascal VOC, Pascal Context, COCO-object, COCO-stuff, and ADE 20K. Especially, the visually appealing segmentation results demonstrate the model capability to localize objects precisely. Paper homepage: https://cvlab.postech.ac.kr/research/lazygrounding

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 90 of its 125 references that are in the map. First posted on arXiv 9 Aug 2024.

Builds on

90 of 125 references.

References · 90

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  6. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  7. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  8. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  9. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  10. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  11. 2023Segment Anythingcited by 8,158
  12. 2023Visual Instruction Tuningcited by 7,792
38 more
  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2017Mask R-CNNcited by 7,259
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  6. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  7. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  8. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  9. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  10. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  11. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  12. 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
  13. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  14. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  15. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
  16. 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
  17. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
  18. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
  19. 2021Florence: A New Foundation Model for Computer Visioncited by 802
  20. 2018Panoptic Segmentationcited by 796
  21. 2022Language-driven Semantic Segmentationcited by 711
  22. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  23. 2021Extract Free Dense Labels from CLIPcited by 580
  24. 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 572
  25. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 560
  26. 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 529
  27. 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 471
  28. 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
  29. 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
  30. 2015Learning Deconvolution Network for Semantic Segmentationcited by 365
  31. 2021CRIS: CLIP-Driven Referring Image Segmentationcited by 353
  32. 2021Deep ViT Features as Dense Visual Descriptorscited by 327
  33. 2019Zero-Shot Semantic Segmentationcited by 245
  34. 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 227
  35. 2021A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Modelcited by 223
  36. 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
  37. 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 215
  38. 2023What does CLIP know about a red circle? Visual prompt engineering for VLMscited by 215

50 most cited of 90 All 90 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 13; 2026: 16.

38 papers.

Sort:

By area:

  1. 2024DINOv2 Meets Text: A Unified Framework for Image- and Pixel-Level Vision-Language Alignmentcited by 79
  2. 2024Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentationcited by 42
  3. 2024Harnessing Vision Foundation Models for High-Performance, Training-Free Open Vocabulary Segmentationcited by 38
  4. 2024Self-Calibrated CLIP for Training-Free Open-Vocabulary Segmentationcited by 34
  5. 2024CorrCLIP: Reconstructing Patch Correlations in CLIP for Open-Vocabulary Semantic Segmentationcited by 33
  6. 2024ResCLIP: Residual Attention for Training-free Dense Vision-language Inferencecited by 28
  7. 2024SegEarth-OV: Towards Training-Free Open-Vocabulary Segmentation for Remote Sensing Imagescited by 25
  8. 2024Distilling Spectral Graph for Object-Context Aware Open-Vocabulary Semantic Segmentationcited by 23
  9. 2025LPOSS: Label Propagation Over Patches and Pixels for Open-vocabulary Semantic Segmentationcited by 21
  10. 2025Mosaic3D: Foundation Dataset and Model for Open-Vocabulary 3D Segmentationcited by 20
  11. 2025Exploring the Underwater World Segmentation without Extra Trainingcited by 16
  12. 2025SegEarth-OV3: Exploring SAM 3 for Open-Vocabulary Semantic Segmentation in Remote Sensing Imagescited by 14
26 more
  1. 2025Training-Free Class Purification for Open-Vocabulary Semantic Segmentationcited by 9
  2. 2025TextRegion: Text-Aligned Region Tokens from Frozen Image-Text Modelscited by 7
  3. 2025Annotation-Free Open-Vocabulary Segmentation for Remote-Sensing Imagescited by 7
  4. 2025Affogato: Open-Vocabulary Affordance Grounding with Automated Data Generation at Scalecited by 6
  5. 2025Target Refocusing via Attention Redistribution for Open-Vocabulary Semantic Segmentation: An Explainability Perspectivecited by 5
  6. 2024Unsupervised Segmentation by Diffusing, Walking and Cuttingcited by 3
  7. 2026Taming SAM3 in the Wild: A Concept Bank for Open-Vocabulary Segmentationcited by 3
  8. 2026PEARL: Geometry Aligns Semantics for Training-Free Open-Vocabulary Semantic Segmentationcited by 3
  9. 2026Enabling Training-Free Text-Based Remote Sensing Segmentationcited by 2
  10. 2026Open-Vocabulary Domain Generalization in Urban-Scene Segmentationcited by 2
  11. 2026Looking Beyond the Window: Global-Local Aligned CLIP for Training-free Open-Vocabulary Semantic Segmentationcited by 2
  12. 2025Improving Visual Discriminability of CLIP for Training-Free Open-Vocabulary Semantic Segmentationcited by 1
  13. 2026DINO Soars: DINOv3 for Open-Vocabulary Semantic Segmentation of Remote Sensing Imagerycited by 1
  14. 2026VIP: Visual-guided Prompt Evolution for Efficient Dense Vision-Language Inferencecited by 1
  15. 2026DINOde: Continuous Vision-Text Alignment for Open-Vocabulary Semantic Segmentationcited by 1
  16. 2025Memory-Modular Classification: Learning to Generalize with Memory Replacementcited by 0
  17. 2025A Survey on Training-free Open-Vocabulary Semantic Segmentationcited by 0
  18. 2025Category-level Text-to-Image Retrieval Improved: Bridging the Domain Gap with Diffusion Models and Vision Encoderscited by 0
  19. 2026Spatial-Regularization-Aware Dual-Branch Collaborative Inference for Training-Free OVSS in Remote Sensing Imagerycited by 0
  20. 2026Retrieve and Segment: Are a Few Examples Enough to Bridge the Supervision Gap in Open-Vocabulary Segmentation?cited by 0
  21. 2026Direct Segmentation without Logits Optimization for Training-Free Open-Vocabulary Semantic Segmentationcited by 0
  22. 2026OV-Stitcher: A Global Context-Aware Framework for Training-Free Open-Vocabulary Semantic Segmentationcited by 0
  23. 2026ActiveSAM: Fast and Accurate Open-Vocabulary Semantic Segmentation with Frozen SAM 3cited by 0
  24. 2026Rapid-Deployment Crack Measurement Based on SAM3 Semantic-Edge Response Decodingcited by 0
  25. 2026Perceptual Anchoring: Prototype-Guided Text Calibration for Training-free Open-Vocabulary Semantic Segmentationcited by 0
  26. 2026Text-to-seed generation: Training-free open-vocabulary seeded semantic segmentation via re-purposing diffusion as text-guided seed generatorcited by 0