mlsanityData to 7 Oct 2026

Channel-Wise Contrastive Learning for Learning with Noisy Labels

arXiv 2308.06952 ↗First posted 14 Aug 2023cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In real-world datasets, noisy labels are pervasive. The challenge of learning with noisy labels (LNL) is to train a classifier that discerns the actual classes from given instances. For this, the model must identify features indicative of the authentic labels. While research indicates that genuine label information is embedded in the learned features of even inaccurately labeled data, it's often intertwined with noise, complicating its direct application. Addressing this, we introduce channel-wise contrastive learning (CWCL). This method distinguishes authentic label information from noise by undertaking contrastive learning across diverse channels. Unlike conventional instance-wise contrastive learning (IWCL), CWCL tends to yield more nuanced and resilient features aligned with the authentic labels. Our strategy is twofold: firstly, using CWCL to extract pertinent features to identify cleanly labeled samples, and secondly, progressively fine-tuning using these samples. Evaluations on several benchmark datasets validate our method's superiority over existing approaches.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 50 references that are in the map. First posted on arXiv 14 Aug 2023.

Builds on

38 of 50 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  7. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  8. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  9. 2020Supervised Contrastive Learningcited by 2,803
  10. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  11. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  12. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
26 more
  1. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
  2. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  3. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
  4. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
  5. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
  6. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
  7. 2017A Closer Look at Memorization in Deep Networkscited by 936
  8. 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 691
  9. 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 663
  10. 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 499
  11. 2020Early-Learning Regularization Prevents Memorization of Noisy Labelscited by 414
  12. 2020Normalized Loss Functions for Deep Learning with Noisy Labelscited by 257
  13. 2016SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioningcited by 219
  14. 2019Are Anchor Points Really Indispensable in Label-Noise Learning?cited by 208
  15. 2020Dual T: Reducing Estimation Error for Transition Matrix in Label-noise Learningcited by 142
  16. 2021Understanding and Improving Early Stopping for Learning with Noisy Labelscited by 112
  17. 2022Selective-Supervised Contrastive Learning with Noisy Labelscited by 112
  18. 2022Robust Training under Label Noise by Over-parameterizationcited by 93
  19. 2020The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classificationcited by 64
  20. 2019Learning Deep Bilinear Transformation for Fine-grained Image Representationcited by 54
  21. 2020Channel Interaction Networks for Fine-Grained Image Categorizationcited by 47
  22. 2020Improving Generalization by Controlling Label-Noise Information in Neural Network Weightscited by 35
  23. 2015Neural Activation Constellations: Unsupervised Part Model Discovery with Convolutional Networkscited by 22
  24. 2022On Learning Contrastive Representations for Learning with Noisy Labelscited by 21
  25. 2022Contrastive Deep Supervisioncited by 20
  26. 2022PADDLES: Phase-Amplitude Spectrum Disentangled Early Stopping for Learning with Noisy Labelscited by 10

Built on by

Not cited yet.