Compound Domain Generalization via Meta-Knowledge Encoding
Not on the map. Why?
Abstract (arXiv)
Domain generalization (DG) aims to improve the generalization performance for an unseen target domain by using the knowledge of multiple seen source domains. Mainstream DG methods typically assume that the domain label of each source sample is known a priori, which is challenged to be satisfied in many real-world applications. In this paper, we study a practical problem of compound DG, which relaxes the discrete domain assumption to the mixed source domains setting. On the other hand, current DG algorithms prioritize the focus on semantic invariance across domains (one-vs-one), while paying less attention to the holistic semantic structure (many-vs-many). Such holistic semantic structure, referred to as meta-knowledge here, is crucial for learning generalizable representations. To this end, we present Compound Domain Generalization via Meta-Knowledge Encoding (COMEN), a general approach to automatically discover and model latent domains in two steps. Firstly, we introduce Style-induced Domain-specific Normalization (SDNorm) to re-normalize the multi-modal underlying distributions, thereby dividing the mixture of source domains into latent clusters. Secondly, we harness the prototype representations, the centroids of classes, to perform relational modeling in the embedding space with two parallel and complementary modules, which explicitly encode the semantic structure for the out-of-distribution generalization. Experiments on four standard DG benchmarks reveal that COMEN exceeds the state-of-the-art performance without the need of domain supervision.
Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Builds on 47 of its 72 references that are in the map. First posted on arXiv 24 Mar 2022.
Builds on
47 of 72 references.
References · 47
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017Graph Attention Networkscited by 8,923
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
- 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,188
- 2017Deeper, Broader and Artier Domain Generalizationcited by 986
35 more
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
- 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 683
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 640
- 2013Domain Generalization via Invariant Feature Representationcited by 623
- 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 600
- 2021Domain Generalization with MixStylecited by 566
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2019Domain Generalization by Solving Jigsaw Puzzlescited by 450
- 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
- 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 407
- 2017Unified Deep Supervised Domain Adaptation and Generalizationcited by 323
- 2020Learning to Generate Novel Domains for Domain Generalizationcited by 296
- 2016Revisiting Batch Normalization For Practical Domain Adaptationcited by 288
- 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
- 2015Domain Generalization for Object Recognition with Multi-task Autoencoderscited by 253
- 2019Episodic Training for Domain Generalizationcited by 245
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2020Deep Domain-Adversarial Image Generation for Domain Generalisationcited by 231
- 2019Domain-Specific Batch Normalization for Unsupervised Domain Adaptationcited by 197
- 2021SelfReg: Self-supervised Contrastive Regularization for Domain Generalizationcited by 189
- 2018Progressive Feature Alignment for Unsupervised Domain Adaptationcited by 183
- 2019Domain Generalization Using a Mixture of Multiple Latent Domainscited by 170
- 2019Learning to Optimize Domain Specific Normalization for Domain Generalizationcited by 161
- 2020Robust and Generalizable Visual Representation Learning via Random Convolutionscited by 142
- 2020Efficient Domain Generalization via Common-Specific Low-Rank Decompositioncited by 134
- 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
- 2019Domain-Symmetric Networks for Adversarial Domain Adaptationcited by 120
- 2020Learning from Extrinsic and Intrinsic Supervisions for Domain Generalizationcited by 108
- 2017AutoDIAL: Automatic DomaIn Alignment Layerscited by 75
- 2020Towards Recognizing Unseen Categories in Unseen Domainscited by 56
- 2018Boosting Domain Adaptation by Discovering Latent Domainscited by 46
- 2020Unsupervised Multi-Class Domain Adaptation: Theory, Algorithms, and Practicecited by 43
- 2020Label Propagation with Augmented Anchors: A Simple Semi-Supervised Learning baseline for Unsupervised Domain Adaptationcited by 35
- 2021I3Net: Implicit Instance-Invariant Network for Adapting One-Stage Object Detectorscited by 28
Built on by
Citing papers per year: 2022: 6; 2023: 23; 2024: 8; 2025: 1; 2026: 2.
40 papers.
Sort:
By area:
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
- 2023Improved Test-Time Adaptation for Domain Generalizationcited by 47
- 2023ALOFT: A Lightweight MLP-like Architecture with Dynamic Low-frequency Transform for Domain Generalizationcited by 28
- 2023SRCD: Semantic Reasoning with Compound Domains for Single-Domain Generalized Object Detectioncited by 28
- 2023Decompose, Adjust, Compose: Effective Normalization by Playing with Frequency for Domain Generalizationcited by 26
- 2022A Comprehensive Survey of Data Augmentation in Visual Reinforcement Learningcited by 25
- 2023What can a cook in Italy teach a mechanic in India? Action Recognition Generalisation Over Scenarios and Locationscited by 25
- 2023DomainDrop: Suppressing Domain-Sensitive Channels for Domain Generalizationcited by 21
- 2022Mix and Reason: Reasoning over Semantic Topology with Data Mixing for Domain Generalizationcited by 20
- 2023Domain Generalization via Rationale Invariancecited by 16
- 2023Domain Generalization in Machine Learning Models for Wireless Communications: Concepts, State-of-the-Art, and Open Issuescited by 12
- 2023Generalized Semantic Segmentation by Self-Supervised Source Domain Projection and Multi-Level Contrastive Learningcited by 11
28 more
- 2023Test-Time Style Shifting: Handling Arbitrary Styles in Domain Generalizationcited by 11
- 2023PVG: Progressive Vision Graph for Vision Recognitioncited by 10
- 2023Activate and Reject: Towards Safe Domain Generalization under Category Shiftcited by 9
- 2022HMOE: Hypernetwork-based Mixture of Experts for Domain Generalizationcited by 8
- 2023Intra- & Extra-Source Exemplar-Based Style Synthesis for Improved Domain Generalizationcited by 8
- 2023NormAUG: Normalization-guided Augmentation for Domain Generalizationcited by 8
- 2023Open Compound Domain Adaptation with Object Style Compensation for Semantic Segmentationcited by 8
- 2024LFME: A Simple Framework for Learning from Multiple Experts in Domain Generalizationcited by 8
- 2023Generalizing to Unseen Domains in Diabetic Retinopathy Classificationcited by 7
- 2024Adaptive Prediction Ensemble: Improving Out-of-Distribution Generalization of Motion Forecastingcited by 7
- 2023MoP-CLIP: A Mixture of Prompt-Tuned CLIP Models for Domain Incremental Learningcited by 6
- 2022A Comprehensive Review of Trends, Applications and Challenges In Out-of-Distribution Detectioncited by 5
- 2023Towards Unified and Effective Domain Generalizationcited by 5
- 2024Learning Generalizable Models via Disentangling Spurious and Enhancing Potential Correlationscited by 5
- 2022Gated Domain Units for Multi-source Domain Generalizationcited by 4
- 2024A Causal Inspired Early-Branching Structure for Domain Generalizationcited by 4
- 2024Feature Diversification and Adaptation for Federated Domain Generalizationcited by 4
- 2024START: A Generalized State Space Model with Saliency-Driven Token-Aware Transformationcited by 4
- 2023Unsupervised Adaptation of Polyp Segmentation Models via Coarse-to-Fine Self-Supervisioncited by 2
- 2023DoubleAUG: Single-domain Generalized Object Detector in Urban via Color Perturbation and Dual-style Memorycited by 2
- 2024Learning in Order! A Sequential Strategy to Learn Invariant Features for Multimodal Sentiment Analysiscited by 2
- 2025Let Synthetic Data Shine: Domain Reassembly and Soft-Fusion for Single Domain Generalizationcited by 2
- 2023Domain Generalization Deep Graph Transformationcited by 1
- 2023Calibration-based Dual Prototypical Contrastive Learning Approach for Domain Generalization Semantic Segmentationcited by 1
- 2023Parameter Exchange for Robust Dynamic Domain Generalizationcited by 1
- 2026Mitigating Simplicity Bias in OOD Detection through Object Co-occurrence Analysiscited by 1
- 2024Mixstyle-Entropy: Domain Generalization with Causal Intervention and Perturbationcited by 0
- 2026CLARE: Scalable Class-Incremental Continual Learning via a Sparsity-Based Frameworkcited by 0
- 2026CLARE: Scalable Class-Incremental Continual Learning via a Sparsity-Based Framework15 Sep 2026
- 2026Mitigating Simplicity Bias in OOD Detection through Object Co-occurrence Analysis8 May 2026
- 2025Let Synthetic Data Shine: Domain Reassembly and Soft-Fusion for Single Domain Generalization17 Mar 2025
- 2024LFME: A Simple Framework for Learning from Multiple Experts in Domain Generalization22 Oct 2024
- 2024START: A Generalized State Space Model with Saliency-Driven Token-Aware Transformation21 Oct 2024
- 2024Learning in Order! A Sequential Strategy to Learn Invariant Features for Multimodal Sentiment Analysis5 Sep 2024
- 2024Mixstyle-Entropy: Domain Generalization with Causal Intervention and Perturbation7 Aug 2024
- 2024Adaptive Prediction Ensemble: Improving Out-of-Distribution Generalization of Motion Forecasting12 Jul 2024
- 2024Feature Diversification and Adaptation for Federated Domain Generalization11 Jul 2024
- 2024A Causal Inspired Early-Branching Structure for Domain Generalization13 Mar 2024
- 2024Learning Generalizable Models via Disentangling Spurious and Enhancing Potential Correlations11 Jan 2024
- 2023Parameter Exchange for Robust Dynamic Domain Generalization23 Nov 2023
28 more
- 2023DoubleAUG: Single-domain Generalized Object Detector in Urban via Color Perturbation and Dual-style Memory22 Nov 2023
- 2023Generalizing to Unseen Domains in Diabetic Retinopathy Classification26 Oct 2023
- 2023Towards Unified and Effective Domain Generalization16 Oct 2023
- 2023Activate and Reject: Towards Safe Domain Generalization under Category Shift7 Oct 2023
- 2023Open Compound Domain Adaptation with Object Style Compensation for Semantic Segmentation28 Sep 2023
- 2023Calibration-based Dual Prototypical Contrastive Learning Approach for Domain Generalization Semantic Segmentation25 Sep 2023
- 2023Domain Generalization via Rationale Invariance22 Aug 2023
- 2023DomainDrop: Suppressing Domain-Sensitive Channels for Domain Generalization20 Aug 2023
- 2023Unsupervised Adaptation of Polyp Segmentation Models via Coarse-to-Fine Self-Supervision13 Aug 2023
- 2023PVG: Progressive Vision Graph for Vision Recognition1 Aug 2023
- 2023NormAUG: Normalization-guided Augmentation for Domain Generalization25 Jul 2023
- 2023MoP-CLIP: A Mixture of Prompt-Tuned CLIP Models for Domain Incremental Learning11 Jul 2023
- 2023SRCD: Semantic Reasoning with Compound Domains for Single-Domain Generalized Object Detection4 Jul 2023
- 2023Intra- & Extra-Source Exemplar-Based Style Synthesis for Improved Domain Generalization2 Jul 2023
- 2023What can a cook in Italy teach a mechanic in India? Action Recognition Generalisation Over Scenarios and Locations14 Jun 2023
- 2023Test-Time Style Shifting: Handling Arbitrary Styles in Domain Generalization8 Jun 2023
- 2023Domain Generalization Deep Graph Transformation19 May 2023
- 2023Improved Test-Time Adaptation for Domain Generalization10 Apr 2023
- 2023ALOFT: A Lightweight MLP-like Architecture with Dynamic Low-frequency Transform for Domain Generalization21 Mar 2023
- 2023Domain Generalization in Machine Learning Models for Wireless Communications: Concepts, State-of-the-Art, and Open Issues13 Mar 2023
- 2023Decompose, Adjust, Compose: Effective Normalization by Playing with Frequency for Domain Generalization4 Mar 2023
- 2023Generalized Semantic Segmentation by Self-Supervised Source Domain Projection and Multi-Level Contrastive Learning3 Mar 2023
- 2022HMOE: Hypernetwork-based Mixture of Experts for Domain Generalization15 Nov 2022
- 2022Mix and Reason: Reasoning over Semantic Topology with Data Mixing for Domain Generalization14 Oct 2022
- 2022A Comprehensive Survey of Data Augmentation in Visual Reinforcement Learning10 Oct 2022
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspective27 Sep 2022
- 2022A Comprehensive Review of Trends, Applications and Challenges In Out-of-Distribution Detection26 Sep 2022
- 2022Gated Domain Units for Multi-source Domain Generalization24 Jun 2022
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
- 2023Improved Test-Time Adaptation for Domain Generalizationcited by 47
- 2023ALOFT: A Lightweight MLP-like Architecture with Dynamic Low-frequency Transform for Domain Generalizationcited by 28
- 2023SRCD: Semantic Reasoning with Compound Domains for Single-Domain Generalized Object Detectioncited by 28
- 2023Decompose, Adjust, Compose: Effective Normalization by Playing with Frequency for Domain Generalizationcited by 26
- 2022A Comprehensive Survey of Data Augmentation in Visual Reinforcement Learningcited by 25
- 2023What can a cook in Italy teach a mechanic in India? Action Recognition Generalisation Over Scenarios and Locationscited by 25
- 2023DomainDrop: Suppressing Domain-Sensitive Channels for Domain Generalizationcited by 21
- 2022Mix and Reason: Reasoning over Semantic Topology with Data Mixing for Domain Generalizationcited by 20
- 2023Domain Generalization via Rationale Invariancecited by 16
- 2023Domain Generalization in Machine Learning Models for Wireless Communications: Concepts, State-of-the-Art, and Open Issuescited by 12
- 2023Generalized Semantic Segmentation by Self-Supervised Source Domain Projection and Multi-Level Contrastive Learningcited by 11
12 most cited of 38 All 38 (JSON)
- 2026CLARE: Scalable Class-Incremental Continual Learning via a Sparsity-Based Framework15 Sep 2026
- 2026Mitigating Simplicity Bias in OOD Detection through Object Co-occurrence Analysis8 May 2026
- 2025Let Synthetic Data Shine: Domain Reassembly and Soft-Fusion for Single Domain Generalization17 Mar 2025
- 2024LFME: A Simple Framework for Learning from Multiple Experts in Domain Generalization22 Oct 2024
- 2024Learning in Order! A Sequential Strategy to Learn Invariant Features for Multimodal Sentiment Analysis5 Sep 2024
- 2024Mixstyle-Entropy: Domain Generalization with Causal Intervention and Perturbation7 Aug 2024
- 2024Adaptive Prediction Ensemble: Improving Out-of-Distribution Generalization of Motion Forecasting12 Jul 2024
- 2024Feature Diversification and Adaptation for Federated Domain Generalization11 Jul 2024
- 2024A Causal Inspired Early-Branching Structure for Domain Generalization13 Mar 2024
- 2024Learning Generalizable Models via Disentangling Spurious and Enhancing Potential Correlations11 Jan 2024
- 2023Parameter Exchange for Robust Dynamic Domain Generalization23 Nov 2023
- 2023DoubleAUG: Single-domain Generalized Object Detector in Urban via Color Perturbation and Dual-style Memory22 Nov 2023
12 newest of 38 All 38 (JSON)