mlsanityData to 7 Oct 2026

SCS-SupCon: Sigmoid-based Common and Style Supervised Contrastive Learning with Adaptive Decision Boundaries

arXiv 2512.17954 ↗First posted 17 Dec 2025cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Image classification is hindered by subtle inter-class differences and substantial intra-class variations, which limit the effectiveness of existing contrastive learning methods. Supervised contrastive approaches based on the InfoNCE loss suffer from negative-sample dilution and lack adaptive decision boundaries, thereby reducing discriminative power in fine-grained recognition tasks. To address these limitations, we propose Sigmoid-based Common and Style Supervised Contrastive Learning (SCS-SupCon). Our framework introduces a sigmoid-based pairwise contrastive loss with learnable temperature and bias parameters to enable adaptive decision boundaries. This formulation emphasizes hard negatives, mitigates negative-sample dilution, and more effectively exploits supervision. In addition, an explicit style-distance constraint further disentangles style and content representations, leading to more robust feature learning. Comprehensive experiments on six benchmark datasets, including CUB200-2011 and Stanford Dogs, demonstrate that SCS-SupCon achieves state-of-the-art performance across both CNN and Transformer backbones. On CIFAR-100 with ResNet-50, SCS-SupCon improves top-1 accuracy over SupCon by approximately 3.9 percentage points and over CS-SupCon by approximately 1.7 points under five-fold cross-validation. On fine-grained datasets, it outperforms CS-SupCon by 0.4--3.0 points. Extensive ablation studies and statistical analyses further confirm the robustness and generalization of the proposed framework, with Friedman tests and Nemenyi post-hoc evaluations validating the stability of the observed improvements.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 17 Dec 2025.

Builds on

20 of 39 references.

References · 20

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  6. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  7. 2020Supervised Contrastive Learningcited by 2,803
  8. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  9. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  10. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
  11. 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
  12. 2020Understanding the Behaviour of Contrastive Losscited by 397
8 more
  1. 2021Parametric Contrastive Learningcited by 217
  2. 2020CoMatch: Semi-supervised Learning with Contrastive Graph Regularizationcited by 167
  3. 2021Decoupled Contrastive Learningcited by 141
  4. 2021Fine-Grained Image Analysis with Deep Learning: A Surveycited by 135
  5. 2020Boosting Contrastive Self-Supervised Learning with False Negative Cancellationcited by 119
  6. 2019Self-Supervised Learning For Few-Shot Image Classificationcited by 44
  7. 2025LaRe: Latent Refocusing for Multimodal Reasoningcited by 7
  8. 2021Self-Contrastive Learning: Single-viewed Supervised Contrastive Framework using Sub-networkcited by 5

Built on by

Not cited yet.