mlsanityData to 14 Oct 2026

CoCo-SAM3: Harnessing Concept Conflict in Open-Vocabulary Semantic Segmentation

arXiv 2604.19648 ↗First posted 21 Apr 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

SAM3 advances open-vocabulary semantic segmentation by introducing a prompt-driven mask generation paradigm. However, in multi-class open-vocabulary scenarios, masks generated independently from different category prompts lack a unified and inter-class comparable evidence scale, often resulting in overlapping coverage and unstable competition. Moreover, synonymous expressions of the same concept tend to activate inconsistent semantic and spatial evidence, leading to intra-class drift that exacerbates inter-class conflicts and compromises overall inference stability. To address these issues, we propose CoCo-SAM3 (Concept-Conflict SAM3), which explicitly decouples inference into intra-class enhancement and inter-class competition. Our method first aligns and aggregates evidence from synonymous prompts to strengthen concept consistency. It then performs inter-class competition on a unified comparable scale, enabling direct pixel-wise comparisons among all candidate classes. This mechanism stabilizes multi-class inference and effectively mitigates inter-class conflicts. Without requiring any additional training, CoCo-SAM3 achieves consistent improvements across eight open-vocabulary semantic segmentation benchmarks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 37 of its 45 references that are in the map. First posted on arXiv 21 Apr 2026.

Builds on

37 of 45 references.

References · 37

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  5. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  7. 2025SAM 3: Segment Anything with Conceptscited by 906
  8. 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 864
  9. 2022Language-driven Semantic Segmentationcited by 717
  10. 2021Extract Free Dense Labels from CLIPcited by 583
  11. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
  12. 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 531
25 more
  1. 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 473
  2. 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
  3. 2019Zero-Shot Semantic Segmentationcited by 245
  4. 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
  5. 2021Decoupling Zero-Shot Semantic Segmentationcited by 199
  6. 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
  7. 2024ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inferencecited by 113
  8. 2024ProxyCLIP: Proxy Attention Improves CLIP for Open-Vocabulary Segmentationcited by 111
  9. 2023SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentationcited by 97
  10. 2023CLIP-DINOiser: Teaching CLIP a few DINO tricks for open-vocabulary semantic segmentationcited by 96
  11. 2023Grounding Everything: Emerging Localization Properties in Vision-Language Transformerscited by 91
  12. 2024Pay Attention to Your Neighbours: Training-Free Open-Vocabulary Semantic Segmentationcited by 77
  13. 2023Token Contrast for Weakly-Supervised Semantic Segmentationcited by 65
  14. 2024Explore the Potential of CLIP for Training-Free Open Vocabulary Semantic Segmentationcited by 61
  15. 2024Training-Free Open-Vocabulary Segmentation with Offline Diffusion-Augmented Prototype Generationcited by 44
  16. 2024Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentationcited by 44
  17. 2024Harnessing Vision Foundation Models for High-Performance, Training-Free Open Vocabulary Segmentationcited by 39
  18. 2024CorrCLIP: Reconstructing Patch Correlations in CLIP for Open-Vocabulary Semantic Segmentationcited by 34
  19. 2024Distilling Spectral Graph for Object-Context Aware Open-Vocabulary Semantic Segmentationcited by 24
  20. 2026ChordEdit: One-Step Low-Energy Transport for Image Editingcited by 18
  21. 2022CAR: Class-aware Regularizations for Semantic Segmentationcited by 14
  22. 2026MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Modelscited by 10
  23. 2025ReME: A Data-Centric Framework for Training-Free Open-Vocabulary Segmentationcited by 9
  24. 2025Target Refocusing via Attention Redistribution for Open-Vocabulary Semantic Segmentation: An Explainability Perspectivecited by 5
  25. 2026Taming SAM3 in the Wild: A Concept Bank for Open-Vocabulary Segmentationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.