Negatives-Dominant Contrastive Learning for Generalization in Imbalanced Domains
Not on the map. Why?
Abstract (arXiv)
Imbalanced Domain Generalization (IDG) focuses on mitigating both domain and label shifts, both of which fundamentally shape the model's decision boundaries, particularly under heterogeneous long-tailed distributions across domains. Despite its practical significance, it remains underexplored, primarily due to the technical complexity of handling their entanglement and the paucity of theoretical foundations. In this paper, we begin by theoretically establishing the generalization bound for IDG, highlighting the role of posterior discrepancy and decision margin. This bound motivates us to focus on directly steering decision boundaries, marking a clear departure from existing methods. Subsequently, we technically propose a novel Negative-Dominant Contrastive Learning (NDCL) for IDG to enhance discriminability while enforce posterior consistency across domains. Specifically, inter-class decision-boundary separation is enhanced by placing greater emphasis on negatives as the primary signal in our contrastive learning, naturally amplifying gradient signals for minority classes to avoid the decision boundary being biased toward majority classes. Meanwhile, intra-class compactness is encouraged through a re-weighted cross-entropy strategy, and posterior consistency across domains is enforced through a prediction-central alignment strategy. Finally, rigorous yet challenging experiments on benchmarks validate the effectiveness of our NDCL. The code is available at https://github.com/Alrash/NDCL.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 39 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
28 of 39 references.
References · 28
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2020Supervised Contrastive Learningcited by 2,829
- 2019Invariant Risk Minimizationcited by 1,854
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
- 2020In Search of Lost Domain Generalizationcited by 1,054
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 742
- 2020Hard Negative Mixing for Contrastive Learningcited by 402
- 2020Balanced Meta-Softmax for Long-Tailed Visual Recognitioncited by 400
16 more
- 2021Gradient Matching for Domain Generalizationcited by 258
- 2021Fishr: Invariant Gradient Variances for Out-of-Distribution Generalizationcited by 186
- 2020Improve Unsupervised Domain Adaptation with Mixup Trainingcited by 185
- 2020Understanding the Failure Modes of Out-of-Distribution Generalizationcited by 146
- 2019Generalizing to unseen domains via distribution matchingcited by 110
- 2020Large-scale Robust Deep AUC Maximization: A New Surrogate Loss and Empirical Studies on Medical Image Classificationcited by 86
- 2022Probable Domain Generalization via Quantile Risk Minimizationcited by 66
- 2020Posterior Re-calibration for Imbalanced Datasetscited by 53
- 2022On Multi-Domain Long-Tailed Recognition, Imbalanced Domain Generalization and Beyondcited by 26
- 2022Localized Adversarial Domain Generalizationcited by 19
- 2023Domain Generalisation via Risk Distribution Matchingcited by 14
- 2023PGrad: Learning Principal Gradients For Domain Generalizationcited by 8
- 2023Imbalanced Domain Generalization for Robust Single Cell Classification in Hematological Cytomorphologycited by 7
- 2022Towards Optimization and Model Selection for Domain Generalization: A Mixup-guided Solutioncited by 6
- 2022Mitigating Both Covariate and Conditional Shift for Domain Generalizationcited by 4
- 2024Causally Inspired Regularization Enables Domain General Representationscited by 4
Built on by
Not cited yet.