mlsanityData to 7 Oct 2026

Open Vocabulary Scene Parsing

arXiv 1703.08769 ↗First posted 26 Mar 2017cs.CV cs.AIcited by 76

Not on the map. Why?

Abstract (arXiv)

Recognizing arbitrary objects in the wild has been a challenging problem due to the limitations of existing classification models and datasets. In this paper, we propose a new task that aims at parsing scenes with a large and open vocabulary, and several evaluation metrics are explored for this problem. Our proposed approach to this problem is a joint image pixel and word concept embeddings framework, where word concepts are connected by semantic relations. We validate the open vocabulary prediction ability of our framework on ADE20K dataset which covers a wide variety of scenes and objects. We further explore the trained joint embedding space to show its interpretability.

Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Mar 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 7; 2022: 11; 2023: 24; 2024: 16; 2025: 5; 2026: 13.

76 papers.

Sort:

By area:

  1. 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 903
  2. 2021Extract Free Dense Labels from CLIPcited by 580
  3. 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 471
  4. 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 302
  5. 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 296
  6. 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 233
  7. 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 215
  8. 2021Decoupling Zero-Shot Semantic Segmentationcited by 198
  9. 2023Towards Open Vocabulary Learning: A Surveycited by 165
  10. 2022PromptDet: Towards Open-vocabulary Detection using Uncurated Imagescited by 133
  11. 2022ReCo: Retrieve and Co-segment for Zero-shot Transfercited by 115
  12. 2022Hyperbolic Image Segmentationcited by 101
38 more
  1. 2023SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentationcited by 95
  2. 2023CLIP-DINOiser: Teaching CLIP a few DINO tricks for open-vocabulary semantic segmentationcited by 94
  3. 2022Deep Hierarchical Semantic Segmentationcited by 84
  4. 2022Perceptual Grouping in Contrastive Vision-Language Modelscited by 82
  5. 2023SILC: Improving Vision Language Pretraining with Self-Distillationcited by 66
  6. 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
  7. 2021Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Cloudscited by 55
  8. 2021Exploiting a Joint Embedding Space for Generalized Zero-Shot Semantic Segmentationcited by 53
  9. 2024Training-Free Open-Vocabulary Segmentation with Offline Diffusion-Augmented Prototype Generationcited by 43
  10. 2024Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentationcited by 42
  11. 2023CLIP-DIY: CLIP Dense Inference Yields Open-Vocabulary Semantic Segmentation For-Freecited by 39
  12. 2024Open-Vocabulary Semantic Segmentation with Image Embedding Balancingcited by 35
  13. 2024CorrCLIP: Reconstructing Patch Correlations in CLIP for Open-Vocabulary Semantic Segmentationcited by 33
  14. 2023Follow Anything: Open-set detection, tracking, and following in real-timecited by 28
  15. 2021Segmentation-grounded Scene Graph Generationcited by 25
  16. 2022Domain-Agnostic Prior for Transfer Semantic Segmentationcited by 18
  17. 2024CLIPer: Hierarchically Improving Spatial Representation of CLIP for Open-Vocabulary Semantic Segmentationcited by 17
  18. 2023Delving into Shape-aware Zero-shot Semantic Segmentationcited by 16
  19. 2023From Text to Mask: Localizing Entities Using the Attention of Text-to-Image Diffusion Modelscited by 16
  20. 2023IFSeg: Image-free Semantic Segmentation via Vision-Language Modelcited by 15
  21. 2024Effective SAM Combination for Open-Vocabulary Semantic Segmentationcited by 15
  22. 2022Hierarchical classification at multiple operating pointscited by 14
  23. 2023Open-Vocabulary Camouflaged Object Segmentationcited by 14
  24. 2024S3M-Net: Joint Learning of Semantic Segmentation and Stereo Matching for Autonomous Drivingcited by 14
  25. 2023Focus on Query: Adversarial Mining Transformer for Few-Shot Segmentationcited by 13
  26. 2023Exploring Open-Vocabulary Semantic Segmentation without Human Labelscited by 10
  27. 2022Graph Reasoning Transformer for Image Parsingcited by 9
  28. 2025Detect Any Sound: Open-Vocabulary Sound Event Detection with Multi-Modal Queriescited by 9
  29. 2024Training-Free Semantic Segmentation via LLM-Supervisioncited by 8
  30. 2024Vocabulary-free Image Classification and Semantic Segmentationcited by 8
  31. 2024View-Consistent Hierarchical 3D Segmentation Using Ultrametric Feature Fieldscited by 8
  32. 2022A Survey on Visual Transfer Learning using Knowledge Graphscited by 7
  33. 2023Open-vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering Modelscited by 7
  34. 2023Rethinking Evaluation Metrics of Open-Vocabulary Segmentaioncited by 7
  35. 2024Renovating Names in Open-Vocabulary Segmentation Benchmarkscited by 7
  36. 2022Scaling up Multi-domain Semantic Segmentation with Sentence Embeddingscited by 6
  37. 2023RaSP: Relation-aware Semantic Prior for Weakly Supervised Incremental Segmentationcited by 6
  38. 2023Frustratingly Simple but Effective Zero-shot Detection and Segmentation: Analysis and a Strong Baselinecited by 5

50 most cited of 76 All 76 (JSON)