SCS-SupCon: Sigmoid-based Common and Style Supervised Contrastive Learning with Adaptive Decision Boundaries
Not on the map. Why?
Abstract (arXiv)
Image classification is hindered by subtle inter-class differences and substantial intra-class variations, which limit the effectiveness of existing contrastive learning methods. Supervised contrastive approaches based on the InfoNCE loss suffer from negative-sample dilution and lack adaptive decision boundaries, thereby reducing discriminative power in fine-grained recognition tasks. To address these limitations, we propose Sigmoid-based Common and Style Supervised Contrastive Learning (SCS-SupCon). Our framework introduces a sigmoid-based pairwise contrastive loss with learnable temperature and bias parameters to enable adaptive decision boundaries. This formulation emphasizes hard negatives, mitigates negative-sample dilution, and more effectively exploits supervision. In addition, an explicit style-distance constraint further disentangles style and content representations, leading to more robust feature learning. Comprehensive experiments on six benchmark datasets, including CUB200-2011 and Stanford Dogs, demonstrate that SCS-SupCon achieves state-of-the-art performance across both CNN and Transformer backbones. On CIFAR-100 with ResNet-50, SCS-SupCon improves top-1 accuracy over SupCon by approximately 3.9 percentage points and over CS-SupCon by approximately 1.7 points under five-fold cross-validation. On fine-grained datasets, it outperforms CS-SupCon by 0.4--3.0 points. Extensive ablation studies and statistical analyses further confirm the robustness and generalization of the proposed framework, with Friedman tests and Nemenyi post-hoc evaluations validating the stability of the observed improvements.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 17 Dec 2025.
Builds on
20 of 39 references.
References · 20
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2020Supervised Contrastive Learningcited by 2,803
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
- 2020Understanding the Behaviour of Contrastive Losscited by 397
8 more
- 2021Parametric Contrastive Learningcited by 217
- 2020CoMatch: Semi-supervised Learning with Contrastive Graph Regularizationcited by 167
- 2021Decoupled Contrastive Learningcited by 141
- 2021Fine-Grained Image Analysis with Deep Learning: A Surveycited by 135
- 2020Boosting Contrastive Self-Supervised Learning with False Negative Cancellationcited by 119
- 2019Self-Supervised Learning For Few-Shot Image Classificationcited by 44
- 2025LaRe: Latent Refocusing for Multimodal Reasoningcited by 7
- 2021Self-Contrastive Learning: Single-viewed Supervised Contrastive Framework using Sub-networkcited by 5
Built on by
Not cited yet.