SynCLIP: Synonym-Coherent Language-Image Pretraining for Robust Open-Vocabulary Dense Perception
Not on the map. Why?
Abstract (arXiv)
Open-vocabulary dense perception (OVDP) aims to localize objects unseen during training by leveraging textual knowledge. Despite the remarkable progress of recent CLIP-based approaches, we identify a critical limitation: synonym-induced grounding inconsistency, where semantically equivalent expressions yield disparate spatial attention patterns. This inconsistency undermines the robustness and performance of existing methods in real-world OVDP applications. To address this issue, we propose SynCLIP, a Synonym-Coherent Language-Image Pretraining framework that enhances synonym-robust grounding for OVDP. SynCLIP introduces a Semantic-consistent Spatial Attention alignment (SSA) module to enhance spatial attention consistency by minimizing discrepancies between attention maps of original and synonymous expressions. Furthermore, a Spatial Attention Refinement (SAR) module selectively strengthens the most semantically relevant spatial regions within aligned maps for more precise and stable grounding. To support synonym-coherent pretraining, we also construct a Synonym-Enriched Visual Corpus (SEViC), which augments each category with multiple synonyms and textual definitions. Extensive experiments on multiple benchmarks demonstrate that SynCLIP substantially improves grounding consistency under diverse linguistic variants and achieves state-of-the-art performance among CLIP-based OVDP methods. Code is available at https://github.com/Justlovesmile/SynCLIP.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 46 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
43 of 46 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2017Mask R-CNNcited by 7,277
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2021Grounded Language-Image Pre-trainingcited by 1,156
- 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 906
31 more
- 2021Florence: A New Foundation Model for Computer Visioncited by 804
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
- 2021Extract Free Dense Labels from CLIPcited by 583
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
- 2022Scaling Language-Image Pre-training via Maskingcited by 317
- 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 300
- 2021A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Modelcited by 223
- 2022Open-Vocabulary DETR with Conditional Matchingcited by 220
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
- 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
- 2023Towards Open Vocabulary Learning: A Surveycited by 166
- 2022F-VLM: Open-Vocabulary Object Detection upon Frozen Vision and Language Modelscited by 150
- 2023CORA: Adapting CLIP for Open-Vocabulary Detection with Region Prompting and Anchor Pre-Matchingcited by 133
- 2023Aligning Bag of Regions for Open-Vocabulary Object Detectioncited by 119
- 2023CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Predictioncited by 118
- 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trendscited by 117
- 2022Learning Object-Language Alignments for Open-Vocabulary Object Detectioncited by 96
- 2023Region-Aware Pretraining for Open-Vocabulary Object Detection with Vision Transformerscited by 91
- 2024GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Graspingcited by 78
- 2024Open-Vocabulary SAM: Segment and Recognize Twenty-thousand Classes Interactivelycited by 75
- 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 61
- 2025DeCLIP: Decoupled Learning for Open-Vocabulary Dense Perceptioncited by 33
- 2023Contrastive Feature Masking Open-Vocabulary Vision Transformercited by 31
- 2024ResCLIP: Residual Attention for Training-free Dense Vision-language Inferencecited by 29
- 2024OV-DQUO: Open-Vocabulary DETR with Denoising Text Query Training and Open-World Unknown Objects Supervisioncited by 22
- 2023CLIM: Contrastive Language-Image Mosaic for Region Representationcited by 21
- 2023Prompt-Guided Transformers for End-to-End Open-Vocabulary Object Detectioncited by 15
- 2025A Hierarchical Semantic Distillation Framework for Open-Vocabulary Object Detectioncited by 9
- 2023EARL: An Elliptical Distribution aided Adaptive Rotation Label Assignment for Oriented Object Detection in Remote Sensing Imagescited by 3
- 2024Band Prompting Aided SAR and Multi-Spectral Data Fusion Framework for Local Climate Zone Classificationcited by 2
Built on by
Not cited yet.