mlsanityData to 7 Oct 2026

Contrastive-Based Deep Embeddings for Label Noise-Resilient Histopathology Image Classification

arXiv 2404.07605 ↗First posted 11 Apr 2024cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent advancements in deep learning have proven highly effective in medical image classification, notably within histopathology. However, noisy labels represent a critical challenge in histopathology image classification, where accurate annotations are vital for training robust deep learning models. Indeed, deep neural networks can easily overfit label noise, leading to severe degradations in model performance. While numerous public pathology foundation models have emerged recently, none have evaluated their resilience to label noise. Through thorough empirical analyses across multiple datasets, we exhibit the label noise resilience property of embeddings extracted from foundation models trained in a self-supervised contrastive manner. We demonstrate that training with such embeddings substantially enhances label noise robustness when compared to non-contrastive-based ones as well as commonly used noise-resilient methods. Our results unequivocally underline the superiority of contrastive learning in effectively mitigating the label noise challenge. Code is publicly available at https://github.com/LucasDedieu/NoiseResilientHistopathology.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 11 Apr 2024.

Builds on

36 of 53 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  8. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  9. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  10. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  11. 2016Understanding deep learning requires rethinking generalizationcited by 1,657
  12. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
24 more
  1. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
  2. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
  3. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
  4. 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 691
  5. 2017Robust Loss Functions under Label Noise for Deep Neural Networkscited by 441
  6. 2018Rotation Equivariant CNNs for Digital Pathologycited by 420
  7. 2019How does Disagreement Help Generalization against Label Corruption?cited by 390
  8. 2020Normalized Loss Functions for Deep Learning with Noisy Labelscited by 257
  9. 2017CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noisecited by 181
  10. 2018Learning to Learn from Noisy Labeled Datacited by 160
  11. 2022Benchmarking Self-Supervised Learning on Diverse Pathology Datasetscited by 148
  12. 2023Virchow: A Million-Slide Digital Pathology Foundation Modelcited by 86
  13. 2021A Petri Dish for Histopathology Image Analysiscited by 63
  14. 2017Learning with Confident Examples: Rank Pruning for Robust Classification with Noisy Labelscited by 52
  15. 2023Towards a Visual-Language Foundation Model for Computational Pathologycited by 52
  16. 2021Co-learning: Learning from Noisy Labels with Self-supervisioncited by 50
  17. 2021Hard Sample Aware Noise Robust Learning for Histopathology Image Classificationcited by 48
  18. 2022Investigating Why Contrastive Learning Benefits Robustness Against Label Noisecited by 46
  19. 2023Computational Pathology at Health System Scale -- Self-Supervised Foundation Models from Three Billion Imagescited by 30
  20. 2021GasHisSDB: A New Gastric Histopathology Image Dataset for Computer Aided Diagnosis of Gastric Cancercited by 17
  21. 2023Improving Medical Image Classification in Noisy Labels Using Only Self-supervised Pretrainingcited by 8
  22. 2023Fine tuning Pre trained Models for Robustness Under Noisy Labelscited by 8
  23. 2024Impact of Noisy Supervision in Foundation Model Learningcited by 8
  24. 2023Label-noise-tolerant medical image classification via self-attention and self-supervised learningcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.