Semi-Supervised Domain Generalization for Object Detection via Language-Guided Feature Alignment
Not on the map. Why?
Abstract (arXiv)
Existing domain adaptation (DA) and generalization (DG) methods in object detection enforce feature alignment in the visual space but face challenges like object appearance variability and scene complexity, which make it difficult to distinguish between objects and achieve accurate detection. In this paper, we are the first to address the problem of semi-supervised domain generalization by exploring vision-language pre-training and enforcing feature alignment through the language space. We employ a novel Cross-Domain Descriptive Multi-Scale Learning (CDDMSL) aiming to maximize the agreement between descriptions of an image presented with different domain-specific characteristics in the embedding space. CDDMSL significantly outperforms existing methods, achieving 11.7% and 7.5% improvement in DG and DA settings, respectively. Comprehensive analysis and ablation studies confirm the effectiveness of our method, positioning CDDMSL as a promising approach for domain generalization in object detection tasks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 49 of its 60 references that are in the map. First posted on arXiv 24 Sep 2023.
Builds on
49 of 60 references.
References · 49
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Mask R-CNNcited by 7,277
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,214
- 2021Grounded Language-Image Pre-trainingcited by 1,156
37 more
- 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 906
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
- 2021Domain Generalization with MixStylecited by 566
- 2021ClipCap: CLIP Prefix for Image Captioningcited by 559
- 2017Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning resultscited by 472
- 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 464
- 2018Domain Adaptive Faster R-CNN for Object Detection in the Wildcited by 443
- 2020Open-Vocabulary Object Detection Using Captionscited by 427
- 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 376
- 2020VirTex: Learning Visual Representations from Textual Annotationscited by 339
- 2018Strong-Weak Distribution Alignment for Adaptive Object Detectioncited by 270
- 2018Cross-Domain Weakly-Supervised Object Detection through Progressive Domain Adaptationcited by 218
- 2018Zero-Shot Object Detectioncited by 189
- 2020Unbiased Mean Teacher for Cross-domain Object Detectioncited by 159
- 2019Exploring Object Relation in Mean Teacher for Cross-Domain Detectioncited by 137
- 2020Harmonizing Transferability and Discriminability for Adapting Object Detectorscited by 126
- 2021Cross-Domain Adaptive Teacher for Object Detectioncited by 126
- 2019Diversify and Match: A Domain Adaptive Representation Learning Paradigm for Object Detectioncited by 123
- 2021Open Domain Generalization with Domain-Augmented Meta-Learningcited by 115
- 2020Cross-domain Detection via Graph-induced Prototype Alignmentcited by 109
- 2022Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbonecited by 109
- 2020Every Pixel Matters: Center-aware Feature Alignment for Domain Adaptive Object Detectorcited by 107
- 2021Unsupervised Domain Adaptation of Object Detectors: A Surveycited by 93
- 2020Cross-domain Object Detection through Coarse-to-Fine Feature Adaptationcited by 82
- 2019Automatic adaptation of object detectors to new domains using self-trainingcited by 66
- 2022Instance Relation Graph Guided Source-Free Domain Adaptive Object Detectioncited by 55
- 2019Align2Ground: Weakly Supervised Phrase Grounding Guided by Image-Caption Alignmentcited by 51
- 2021Exploring Sequence Feature Alignment for Domain Adaptive Detection Transformerscited by 49
- 2022Cross Domain Object Detection by Target-Perceived Dual Branch Distillationcited by 46
- 2019Domain Adaptation for Object Detection via Style Consistencycited by 45
- 2021Seeking Similarities over Differences: Similarity-based Domain Alignment for Adaptive Object Detectioncited by 45
- 2021Semi-Supervised Domain Generalization with Stochastic StyleMatchcited by 43
- 2021Semi-supervised Meta-learning with Disentanglement for Domain-generalised Medical Image Segmentationcited by 36
- 2019Cap2Det: Learning to Amplify Weak Caption Supervision for Object Detectioncited by 31
- 2021Domain-Specific Suppression for Adaptive Object Detectioncited by 26
- 2021AFAN: Augmented Feature Alignment Network for Cross-Domain Object Detectioncited by 19
- 2017Aligned Image-Word Representations Improve Inductive Transfer Across Vision-Language Taskscited by 9
Built on by
Citing papers per year: 2023: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Strong but simple: A Baseline for Domain Generalized Dense Perception by CLIP-based Transfer Learning
- 2025Boosting Single-domain Generalized Object Detection via Vision-Language Knowledge Interaction
- 2023CLIP the Gap: A Single Domain Generalization Approach for Object Detection
- 2026SemAlign: Language Guided Semi-supervised Domain Generalization
- 2026CD-FKD: Cross-Domain Feature Knowledge Distillation for Robust Single-Domain Generalization in Object Detection
- 2025Language-Driven Dual Style Mixing for Single-Domain Generalized Object Detection
- 2024Feature Based Methods in Domain Adaptation for Object Detection: A Review Paper
- 2024PracticalDG: Perturbation Distillation on Vision-Language Models for Hybrid Domain Generalization