mlsanityData to 7 Oct 2026

DICS: Find Domain-Invariant and Class-Specific Features for Out-of-Distribution Generalization

arXiv 2409.08557 ↗First posted 13 Sep 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

While deep neural networks have made remarkable progress in various vision tasks, their performance typically deteriorates when tested in out-of-distribution (OOD) scenarios. Many OOD methods focus on extracting domain-invariant features but neglect whether these features are unique to each class. Even if some features are domain-invariant, they cannot serve as key classification criteria if shared across different classes. In OOD tasks, both domain-related and class-shared features act as confounders that hinder generalization. In this paper, we propose a DICS model to extract Domain-Invariant and Class-Specific features, including Domain Invariance Testing (DIT) and Class Specificity Testing (CST), which mitigate the effects of spurious correlations introduced by confounders. DIT learns domain-related features of each source domain and removes them from inputs to isolate domain-invariant class-related features. DIT ensures domain invariance by aligning same-class features across different domains. Then, CST calculates soft labels for those features by comparing them with features learned in previous steps. We optimize the cross-entropy between the soft labels and their true labels, which enhances same-class similarity and different-class distinctiveness, thereby reinforcing class specificity. Extensive experiments on widely-used benchmarks demonstrate the effectiveness of our proposed algorithm. Additional visualizations further demonstrate that DICS effectively identifies the key features of each class in target domains.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 48 of its 60 references that are in the map. First posted on arXiv 13 Sep 2024.

Builds on

48 of 60 references.

References · 48

  1. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  3. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  4. 2019Invariant Risk Minimizationcited by 1,832
  5. 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
  6. 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
  7. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
  8. 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,181
  9. 2020In Search of Lost Domain Generalizationcited by 1,042
  10. 2017Deeper, Broader and Artier Domain Generalizationcited by 983
  11. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
  12. 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
36 more
  1. 2021Domain Generalization with MixStylecited by 563
  2. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  3. 2019Domain Generalization by Solving Jigsaw Puzzlescited by 449
  4. 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
  5. 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 405
  6. 2020Learning to Generate Novel Domains for Domain Generalizationcited by 296
  7. 2018Taking A Closer Look at Domain Shift: Category-level Adversaries for Semantics Consistent Domain Adaptationcited by 295
  8. 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
  9. 2019Episodic Training for Domain Generalizationcited by 245
  10. 2019Causality for Machine Learningcited by 242
  11. 2020Deep Domain-Adversarial Image Generation for Domain Generalisationcited by 231
  12. 2020Domain Generalization using Causal Matchingcited by 224
  13. 2021Fishr: Invariant Gradient Variances for Out-of-Distribution Generalizationcited by 186
  14. 2020Improve Unsupervised Domain Adaptation with Mixup Trainingcited by 185
  15. 2020Adaptive Risk Minimization: Learning to Adapt to Domain Shiftcited by 183
  16. 2017Domain Generalization by Marginal Transfer Learningcited by 180
  17. 2019Domain Generalization Using a Mixture of Multiple Latent Domainscited by 170
  18. 2021Deep Stable Learning for Out-Of-Distribution Generalizationcited by 153
  19. 2018Domain Generalization via Conditional Invariant Representationcited by 146
  20. 2019Feature-Critic Networks for Heterogeneous Domain Generalizationcited by 130
  21. 2018Anchor regression: heterogeneous data meets causalitycited by 116
  22. 2020Learning from Extrinsic and Intrinsic Supervisions for Domain Generalizationcited by 108
  23. 2021Invariant Information Bottleneck for Domain Generalizationcited by 86
  24. 2022Probable Domain Generalization via Quantile Risk Minimizationcited by 66
  25. 2021SAND-mask: An Enhanced Gradient Masking Strategy for the Discovery of Invariances in Domain Generalizationcited by 50
  26. 2022From Statistical to Causal Learningcited by 40
  27. 2014Maximin effects in inhomogeneous large-scale datacited by 32
  28. 2021A Style and Semantic Memory Mechanism for Domain Generalizationcited by 32
  29. 2022Invariant Causal Mechanisms through Distribution Matchingcited by 31
  30. 2022Causal Balancing for Domain Generalizationcited by 20
  31. 2023Domain Generalisation via Risk Distribution Matchingcited by 14
  32. 2022Domain Generalization via Contrastive Causal Learningcited by 8
  33. 2022Causal Inference via Style Transfer for Out-of-distribution Generalisationcited by 8
  34. 2022Learning Instrumental Variable from Data Fusion for Treatment Effect Estimationcited by 5
  35. 2023ADRMX: Additive Disentanglement of Domain Features with Remix Losscited by 5
  36. 2022Investigating the Robustness of Natural Language Generation from Logical Forms via Counterfactual Samplescited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.