Anatomy-aware Self-supervised Learning for Anomaly Detection in Chest Radiographs
Not on the map. Why?
Abstract (arXiv)
Large numbers of labeled medical images are essential for the accurate detection of anomalies, but manual annotation is labor-intensive and time-consuming. Self-supervised learning (SSL) is a training method to learn data-specific features without manual annotation. Several SSL-based models have been employed in medical image anomaly detection. These SSL methods effectively learn representations in several field-specific images, such as natural and industrial product images. However, owing to the requirement of medical expertise, typical SSL-based models are inefficient in medical image anomaly detection. We present an SSL-based model that enables anatomical structure-based unsupervised anomaly detection (UAD). The model employs the anatomy-aware pasting (AnatPaste) augmentation tool. AnatPaste employs a threshold-based lung segmentation pretext task to create anomalies in normal chest radiographs, which are used for model pretraining. These anomalies are similar to real anomalies and help the model recognize them. We evaluate our model on three opensource chest radiograph datasets. Our model exhibit area under curves (AUC) of 92.1%, 78.7%, and 81.9%, which are the highest among existing UAD models. This is the first SSL model to employ anatomical information as a pretext task. AnatPaste can be applied in various deep learning models and downstream tasks. It can be employed for other modalities by fixing appropriate segmentation. Our code is publicly available at: https://github.com/jun-sato/AnatPaste.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 33 of its 73 references that are in the map. First posted on arXiv 9 May 2022.
Builds on
33 of 73 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 636
21 more
- 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 451
- 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
- 2021Big Self-Supervised Models Advance Medical Image Classificationcited by 320
- 2020Deep Learning for Anomaly Detection: A Reviewcited by 159
- 2020Autoencoders for Unsupervised Anomaly Segmentation in Brain MR Images: A Comparative Studycited by 146
- 2020Self-Path: Self-supervision for Classification of Pathology Images with Limited Annotationscited by 89
- 2021SimCVD: Simple Contrastive Voxel-Wise Representation Distillation for Semi-Supervised Medical Image Segmentationcited by 86
- 2021Generalized Radiograph Representation Learning via Cross-supervision between Images and Free-text Radiology Reportscited by 80
- 2021Deep One-Class Classification via Interpolated Gaussian Descriptorcited by 67
- 2020MoCo-CXR: MoCo Pretraining Improves Representation and Transferability of Chest X-ray Modelscited by 61
- 2021Preservational Learning Improves Self-supervised Medical Image Models by Reconstructing Diverse Contextscited by 59
- 2021MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretationcited by 52
- 2020Self-supervised Feature Learning via Exploiting Multi-modal Data for Retinal Disease Diagnosiscited by 47
- 2015How much data is needed to train a medical image deep learning system to achieve necessary high accuracy?cited by 45
- 2021Constrained Contrastive Distribution Learning for Unsupervised Anomaly Detection and Localisation in Medical Imagescited by 45
- 2021COVID-19 Prognosis via Self-Supervised Representation Learning and Multi-Image Predictioncited by 36
- 2021SQUID: Deep Feature In-Painting for Unsupervised Anomaly Detectioncited by 34
- 2021Unsupervised Detection of Lung Nodules in Chest Radiography Using Generative Adversarial Networkscited by 4
- 2018Pneumonia Detection in Chest Radiographscited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 5; 2025: 3; 2026: 2.
12 papers.
- 2022Robust and Efficient Medical Imaging with Self-Supervisioncited by 40
- 2024MedIAnomaly: A comparative study of anomaly detection in medical imagescited by 25
- 2024Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Imagescited by 13
- 2023AMAE: Adaptation of Pre-Trained Masked Autoencoder for Dual-Distribution Anomaly Detection in Chest X-Rayscited by 8
- 2024Position-Guided Prompt Learning for Anomaly Detection in Chest X-Rayscited by 3
- 2025AFiRe: Anatomy-Driven Self-Supervised Learning for Fine-Grained Representation in Radiographic Imagescited by 3
- 2024DINO-LG: Enhancing Vision Transformers with Label Guidance for Coronary Artery Calcium Detectioncited by 1
- 2025ART-ASyn: Anatomy-aware Realistic Texture-based Anomaly Synthesis Framework for Chest X-Rayscited by 1
- 2024Training Better Deep Learning Models Using Human Saliencycited by 0
- 2025DiSSECT: Structuring Transfer-Ready Medical Image Representations through Discrete Self-Supervisioncited by 0
- 2026Towards Modality-Agnostic Medical Image Anomaly Detection: A Training-Free Manifold Refinement Approachcited by 0
- 2026AUCp: Pseudo-AUC for Inference Model Selection with Unlabeled Validation Data in Abnormality Detectioncited by 0
- 2026AUCp: Pseudo-AUC for Inference Model Selection with Unlabeled Validation Data in Abnormality Detection7 Jun 2026
- 2026Towards Modality-Agnostic Medical Image Anomaly Detection: A Training-Free Manifold Refinement Approach21 Apr 2026
- 2025ART-ASyn: Anatomy-aware Realistic Texture-based Anomaly Synthesis Framework for Chest X-Rays29 Nov 2025
- 2025DiSSECT: Structuring Transfer-Ready Medical Image Representations through Discrete Self-Supervision23 Sep 2025
- 2025AFiRe: Anatomy-Driven Self-Supervised Learning for Fine-Grained Representation in Radiographic Images15 Apr 2025
- 2024DINO-LG: Enhancing Vision Transformers with Label Guidance for Coronary Artery Calcium Detection12 Nov 2024
- 2024Training Better Deep Learning Models Using Human Saliency21 Oct 2024
- 2024Position-Guided Prompt Learning for Anomaly Detection in Chest X-Rays20 May 2024
- 2024MedIAnomaly: A comparative study of anomaly detection in medical images6 Apr 2024
- 2024Exploiting Structural Consistency of Chest Anatomy for Unsupervised Anomaly Detection in Radiography Images13 Mar 2024
- 2023AMAE: Adaptation of Pre-Trained Masked Autoencoder for Dual-Distribution Anomaly Detection in Chest X-Rays24 Jul 2023
- 2022Robust and Efficient Medical Imaging with Self-Supervision19 May 2022