CoCo-SAM3: Harnessing Concept Conflict in Open-Vocabulary Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
SAM3 advances open-vocabulary semantic segmentation by introducing a prompt-driven mask generation paradigm. However, in multi-class open-vocabulary scenarios, masks generated independently from different category prompts lack a unified and inter-class comparable evidence scale, often resulting in overlapping coverage and unstable competition. Moreover, synonymous expressions of the same concept tend to activate inconsistent semantic and spatial evidence, leading to intra-class drift that exacerbates inter-class conflicts and compromises overall inference stability. To address these issues, we propose CoCo-SAM3 (Concept-Conflict SAM3), which explicitly decouples inference into intra-class enhancement and inter-class competition. Our method first aligns and aggregates evidence from synonymous prompts to strengthen concept consistency. It then performs inter-class competition on a unified comparable scale, enabling direct pixel-wise comparisons among all candidate classes. This mechanism stabilizes multi-class inference and effectively mitigates inter-class conflicts. Without requiring any additional training, CoCo-SAM3 achieves consistent improvements across eight open-vocabulary semantic segmentation benchmarks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 37 of its 45 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
37 of 45 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 864
- 2022Language-driven Semantic Segmentationcited by 717
- 2021Extract Free Dense Labels from CLIPcited by 583
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
- 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 531
25 more
- 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 473
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
- 2019Zero-Shot Semantic Segmentationcited by 245
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
- 2021Decoupling Zero-Shot Semantic Segmentationcited by 199
- 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
- 2024ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inferencecited by 113
- 2024ProxyCLIP: Proxy Attention Improves CLIP for Open-Vocabulary Segmentationcited by 111
- 2023SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentationcited by 97
- 2023CLIP-DINOiser: Teaching CLIP a few DINO tricks for open-vocabulary semantic segmentationcited by 96
- 2023Grounding Everything: Emerging Localization Properties in Vision-Language Transformerscited by 91
- 2024Pay Attention to Your Neighbours: Training-Free Open-Vocabulary Semantic Segmentationcited by 77
- 2023Token Contrast for Weakly-Supervised Semantic Segmentationcited by 65
- 2024Explore the Potential of CLIP for Training-Free Open Vocabulary Semantic Segmentationcited by 61
- 2024Training-Free Open-Vocabulary Segmentation with Offline Diffusion-Augmented Prototype Generationcited by 44
- 2024Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentationcited by 44
- 2024Harnessing Vision Foundation Models for High-Performance, Training-Free Open Vocabulary Segmentationcited by 39
- 2024CorrCLIP: Reconstructing Patch Correlations in CLIP for Open-Vocabulary Semantic Segmentationcited by 34
- 2024Distilling Spectral Graph for Object-Context Aware Open-Vocabulary Semantic Segmentationcited by 24
- 2026ChordEdit: One-Step Low-Energy Transport for Image Editingcited by 18
- 2022CAR: Class-aware Regularizations for Semantic Segmentationcited by 14
- 2026MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Modelscited by 10
- 2025ReME: A Data-Centric Framework for Training-Free Open-Vocabulary Segmentationcited by 9
- 2025Target Refocusing via Attention Redistribution for Open-Vocabulary Semantic Segmentation: An Explainability Perspectivecited by 5
- 2026Taming SAM3 in the Wild: A Concept Bank for Open-Vocabulary Segmentationcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.