DICS: Find Domain-Invariant and Class-Specific Features for Out-of-Distribution Generalization
Not on the map. Why?
Abstract (arXiv)
While deep neural networks have made remarkable progress in various vision tasks, their performance typically deteriorates when tested in out-of-distribution (OOD) scenarios. Many OOD methods focus on extracting domain-invariant features but neglect whether these features are unique to each class. Even if some features are domain-invariant, they cannot serve as key classification criteria if shared across different classes. In OOD tasks, both domain-related and class-shared features act as confounders that hinder generalization. In this paper, we propose a DICS model to extract Domain-Invariant and Class-Specific features, including Domain Invariance Testing (DIT) and Class Specificity Testing (CST), which mitigate the effects of spurious correlations introduced by confounders. DIT learns domain-related features of each source domain and removes them from inputs to isolate domain-invariant class-related features. DIT ensures domain invariance by aligning same-class features across different domains. Then, CST calculates soft labels for those features by comparing them with features learned in previous steps. We optimize the cross-entropy between the soft labels and their true labels, which enhances same-class similarity and different-class distinctiveness, thereby reinforcing class specificity. Extensive experiments on widely-used benchmarks demonstrate the effectiveness of our proposed algorithm. Additional visualizations further demonstrate that DICS effectively identifies the key features of each class in target domains.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 48 of its 60 references that are in the map. First posted on arXiv 13 Sep 2024.
Builds on
48 of 60 references.
References · 48
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2019Invariant Risk Minimizationcited by 1,832
- 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
- 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,181
- 2020In Search of Lost Domain Generalizationcited by 1,042
- 2017Deeper, Broader and Artier Domain Generalizationcited by 983
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
36 more
- 2021Domain Generalization with MixStylecited by 563
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2019Domain Generalization by Solving Jigsaw Puzzlescited by 449
- 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
- 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 405
- 2020Learning to Generate Novel Domains for Domain Generalizationcited by 296
- 2018Taking A Closer Look at Domain Shift: Category-level Adversaries for Semantics Consistent Domain Adaptationcited by 295
- 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
- 2019Episodic Training for Domain Generalizationcited by 245
- 2019Causality for Machine Learningcited by 242
- 2020Deep Domain-Adversarial Image Generation for Domain Generalisationcited by 231
- 2020Domain Generalization using Causal Matchingcited by 224
- 2021Fishr: Invariant Gradient Variances for Out-of-Distribution Generalizationcited by 186
- 2020Improve Unsupervised Domain Adaptation with Mixup Trainingcited by 185
- 2020Adaptive Risk Minimization: Learning to Adapt to Domain Shiftcited by 183
- 2017Domain Generalization by Marginal Transfer Learningcited by 180
- 2019Domain Generalization Using a Mixture of Multiple Latent Domainscited by 170
- 2021Deep Stable Learning for Out-Of-Distribution Generalizationcited by 153
- 2018Domain Generalization via Conditional Invariant Representationcited by 146
- 2019Feature-Critic Networks for Heterogeneous Domain Generalizationcited by 130
- 2018Anchor regression: heterogeneous data meets causalitycited by 116
- 2020Learning from Extrinsic and Intrinsic Supervisions for Domain Generalizationcited by 108
- 2021Invariant Information Bottleneck for Domain Generalizationcited by 86
- 2022Probable Domain Generalization via Quantile Risk Minimizationcited by 66
- 2021SAND-mask: An Enhanced Gradient Masking Strategy for the Discovery of Invariances in Domain Generalizationcited by 50
- 2022From Statistical to Causal Learningcited by 40
- 2014Maximin effects in inhomogeneous large-scale datacited by 32
- 2021A Style and Semantic Memory Mechanism for Domain Generalizationcited by 32
- 2022Invariant Causal Mechanisms through Distribution Matchingcited by 31
- 2022Causal Balancing for Domain Generalizationcited by 20
- 2023Domain Generalisation via Risk Distribution Matchingcited by 14
- 2022Domain Generalization via Contrastive Causal Learningcited by 8
- 2022Causal Inference via Style Transfer for Out-of-distribution Generalisationcited by 8
- 2022Learning Instrumental Variable from Data Fusion for Treatment Effect Estimationcited by 5
- 2023ADRMX: Additive Disentanglement of Domain Features with Remix Losscited by 5
- 2022Investigating the Robustness of Natural Language Generation from Logical Forms via Counterfactual Samplescited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Class Unbiasing for Generalization in Medical Diagnosiscited by 0
- 2025Class Unbiasing for Generalization in Medical Diagnosis9 Aug 2025