mlsanityData to 7 Oct 2026

Self-Knowledge Distillation based Self-Supervised Learning for Covid-19 Detection from Chest X-Ray Images

arXiv 2206.03009 ↗First posted 7 Jun 2022eess.IV cs.CV cs.LGcited by 13

Not on the map. Why?

Abstract (arXiv)

The global outbreak of the Coronavirus 2019 (COVID-19) has overloaded worldwide healthcare systems. Computer-aided diagnosis for COVID-19 fast detection and patient triage is becoming critical. This paper proposes a novel self-knowledge distillation based self-supervised learning method for COVID-19 detection from chest X-ray images. Our method can use self-knowledge of images based on similarities of their visual features for self-supervised learning. Experimental results show that our method achieved an HM score of 0.988, an AUC of 0.999, and an accuracy of 0.957 on the largest open COVID-19 chest X-ray dataset.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 14 of its 25 references that are in the map. First posted on arXiv 7 Jun 2022.

Builds on

14 of 25 references.

References · 14

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  4. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  5. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  6. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
  7. 2020What Makes for Good Views for Contrastive Learning?cited by 843
  8. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
  9. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  10. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  11. 2020Deep Learning COVID-19 Features on CXR using Limited Training Data Setscited by 68
  12. 2021Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classificationcited by 16
2 more
  1. 2021Self-Supervised Learning for Gastritis Detection with Gastric X-ray Imagescited by 9
  2. 2021Graph-based Pyramid Global Context Reasoning with a Saliency-aware Projection for COVID-19 Lung Infections Segmentationcited by 5

Built on by

Cited by year

Citing papers per year: 2022: 6; 2023: 1; 2024: 3; 2025: 3.

13 papers.

Sort:

  1. 2022Compressed Gastric Image Generation Based on Soft-Label Dataset Distillation for Medical Data Sharingcited by 35
  2. 2022Dataset Distillation Using Parameter Pruningcited by 27
  3. 2022Dataset Distillation for Medical Dataset Sharingcited by 25
  4. 2024Importance-Aware Adaptive Dataset Distillationcited by 18
  5. 2024Boosting Masked ECG-Text Auto-Encoders as Discriminative Learnerscited by 16
  6. 2022COVID-19 Detection Based on Self-Supervised Transfer Learning Using Chest X-Ray Imagescited by 7
  7. 2025Continual Self-supervised Learning Considering Medical Domain Knowledge in Chest CT Imagescited by 5
  8. 2022Boosting Automatic COVID-19 Detection Performance with Self-Supervised Learning and Batch Knowledge Ensemblingcited by 3
  9. 2024From Barlow Twins to Triplet Training: Differentiating Dementia with Limited Datacited by 3
  10. 2023A Survey of the Impact of Self-Supervised Pretraining for Diagnostic Tasks with Radiological Imagescited by 2
  11. 2022RGMIM: Region-Guided Masked Image Modeling for Learning Meaningful Representations from X-Ray Imagescited by 1
  12. 2025Privacy-Aware Continual Self-Supervised Learning on Multi-Window Chest Computed Tomography for Domain-Shift Robustnesscited by 1
1 more
  1. 2025Dual-Model Weight Selection and Self-Knowledge Distillation for Medical Image Classificationcited by 0