mlsanityData to 14 Oct 2026

SynCLIP: Synonym-Coherent Language-Image Pretraining for Robust Open-Vocabulary Dense Perception

arXiv 2607.11008 ↗First posted 13 Jul 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-vocabulary dense perception (OVDP) aims to localize objects unseen during training by leveraging textual knowledge. Despite the remarkable progress of recent CLIP-based approaches, we identify a critical limitation: synonym-induced grounding inconsistency, where semantically equivalent expressions yield disparate spatial attention patterns. This inconsistency undermines the robustness and performance of existing methods in real-world OVDP applications. To address this issue, we propose SynCLIP, a Synonym-Coherent Language-Image Pretraining framework that enhances synonym-robust grounding for OVDP. SynCLIP introduces a Semantic-consistent Spatial Attention alignment (SSA) module to enhance spatial attention consistency by minimizing discrepancies between attention maps of original and synonymous expressions. Furthermore, a Spatial Attention Refinement (SAR) module selectively strengthens the most semantically relevant spatial regions within aligned maps for more precise and stable grounding. To support synonym-coherent pretraining, we also construct a Synonym-Enriched Visual Corpus (SEViC), which augments each category with multiple synonyms and textual definitions. Extensive experiments on multiple benchmarks demonstrate that SynCLIP substantially improves grounding consistency under diverse linguistic variants and achieves state-of-the-art performance among CLIP-based OVDP methods. Code is available at https://github.com/Justlovesmile/SynCLIP.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 46 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

43 of 46 references.

References · 43

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2017Mask R-CNNcited by 7,277
  8. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  9. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  10. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  11. 2021Grounded Language-Image Pre-trainingcited by 1,156
  12. 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 906
31 more
  1. 2021Florence: A New Foundation Model for Computer Visioncited by 804
  2. 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
  3. 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
  4. 2021Extract Free Dense Labels from CLIPcited by 583
  5. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
  6. 2022Scaling Language-Image Pre-training via Maskingcited by 317
  7. 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 300
  8. 2021A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Modelcited by 223
  9. 2022Open-Vocabulary DETR with Conditional Matchingcited by 220
  10. 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
  11. 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
  12. 2023Towards Open Vocabulary Learning: A Surveycited by 166
  13. 2022F-VLM: Open-Vocabulary Object Detection upon Frozen Vision and Language Modelscited by 150
  14. 2023CORA: Adapting CLIP for Open-Vocabulary Detection with Region Prompting and Anchor Pre-Matchingcited by 133
  15. 2023Aligning Bag of Regions for Open-Vocabulary Object Detectioncited by 119
  16. 2023CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Predictioncited by 118
  17. 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trendscited by 117
  18. 2022Learning Object-Language Alignments for Open-Vocabulary Object Detectioncited by 96
  19. 2023Region-Aware Pretraining for Open-Vocabulary Object Detection with Vision Transformerscited by 91
  20. 2024GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Graspingcited by 78
  21. 2024Open-Vocabulary SAM: Segment and Recognize Twenty-thousand Classes Interactivelycited by 75
  22. 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 61
  23. 2025DeCLIP: Decoupled Learning for Open-Vocabulary Dense Perceptioncited by 33
  24. 2023Contrastive Feature Masking Open-Vocabulary Vision Transformercited by 31
  25. 2024ResCLIP: Residual Attention for Training-free Dense Vision-language Inferencecited by 29
  26. 2024OV-DQUO: Open-Vocabulary DETR with Denoising Text Query Training and Open-World Unknown Objects Supervisioncited by 22
  27. 2023CLIM: Contrastive Language-Image Mosaic for Region Representationcited by 21
  28. 2023Prompt-Guided Transformers for End-to-End Open-Vocabulary Object Detectioncited by 15
  29. 2025A Hierarchical Semantic Distillation Framework for Open-Vocabulary Object Detectioncited by 9
  30. 2023EARL: An Elliptical Distribution aided Adaptive Rotation Label Assignment for Oriented Object Detection in Remote Sensing Imagescited by 3
  31. 2024Band Prompting Aided SAR and Multi-Spectral Data Fusion Framework for Local Climate Zone Classificationcited by 2

Built on by

Not cited yet.