Detecting Shortcuts in Medical Images -- A Case Study in Chest X-rays
Not on the map. Why?
Abstract (arXiv)
The availability of large public datasets and the increased amount of computing power have shifted the interest of the medical community to high-performance algorithms. However, little attention is paid to the quality of the data and their annotations. High performance on benchmark datasets may be reported without considering possible shortcuts or artifacts in the data, besides, models are not tested on subpopulation groups. With this work, we aim to raise awareness about shortcuts problems. We validate previous findings, and present a case study on chest X-rays using two publicly available datasets. We share annotations for a subset of pneumothorax images with drains. We conclude with general recommendations for medical image classification.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 13 of its 28 references that are in the map. First posted on arXiv 8 Nov 2022.
Builds on
13 of 28 references.
References · 13
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2014Certifying and removing disparate impactcited by 715
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
- 2017On Fairness and Calibrationcited by 406
- 2019Hidden Stratification Causes Clinically Meaningful Failures in Machine Learning for Medical Imagingcited by 215
- 2021Reading Race: AI Recognises Patient's Racial Identity In Medical Imagescited by 155
- 2020CheXclusion: Fairness gaps in deep chest X-ray classifierscited by 153
- 2018Classification with Fairness Constraints: A Meta-Algorithm with Provable Guaranteescited by 146
Built on by
Citing papers per year: 2023: 4; 2024: 5; 2025: 4; 2026: 7.
20 papers.
Sort:
By area:
- 2023Fast Diffusion-Based Counterfactuals for Shortcut Removal and Generationcited by 41
- 2024Shortcut Learning in Medical Image Segmentationcited by 16
- 2024Slicing Through Bias: Explaining Performance Gaps in Medical Image Analysis using Slice Discovery Methodscited by 14
- 2023How You Split Matters: Data Leakage and Subject Characteristics Studies in Longitudinal Brain MRI Analysiscited by 8
- 2023Augmenting Chest X-ray Datasets with Non-Expert Annotationscited by 6
- 2024Mask of truth: model sensitivity to unexpected regions of medical imagescited by 6
- 2024Copycats: the many lives of a publicly available medical imaging datasetcited by 5
- 2025Subgroup Performance Analysis in Hidden Stratificationscited by 3
- 2024Dataset Distribution Impacts Model Fairness: Single vs. Multi-Task Learningcited by 2
- 2023Distributionally Robust Optimization and Invariant Representation Learning for Addressing Subgroup Underrepresentation: Mechanisms and Limitationscited by 1
- 2025Fairness and Robustness of CLIP-Based Models for Chest X-rayscited by 1
- 2026Dataset Diversity Metrics and Impact on Classification Modelscited by 1
8 more
- 2026Prevalence calibration as shortcut mitigationcited by 1
- 2025meval: A Statistical Toolbox for Fine-Grained Model Performance Analysiscited by 0
- 2025Localising Shortcut Learning in Pixel Space via Ordinal Scoring Correlations for Attribution Representations (OSCAR)cited by 0
- 2026Effect of Demographic Bias on Skin Lesion Classificationcited by 0
- 2026SHOVIR: A Benchmark for Evaluating Vision Shortcut Learning in Radiology Report Generationcited by 0
- 2026ReMoDEx: A Local-to-Global Relevance-Based Model Decision Explainability Framework for large-Scale Image Datasetscited by 0
- 2026P3CA: Encoder-Agnostic Interpretation of Vision Foundation Model Embeddings via Spatial Probingcited by 0
- 2026Look What the Probes Dragged In! Real-World Chest X-ray Shortcuts in MedCLIPcited by 0
- 2026Prevalence calibration as shortcut mitigation7 Sep 2026
- 2026Look What the Probes Dragged In! Real-World Chest X-ray Shortcuts in MedCLIP12 Aug 2026
- 2026P3CA: Encoder-Agnostic Interpretation of Vision Foundation Model Embeddings via Spatial Probing10 Aug 2026
- 2026ReMoDEx: A Local-to-Global Relevance-Based Model Decision Explainability Framework for large-Scale Image Datasets8 Jul 2026
- 2026SHOVIR: A Benchmark for Evaluating Vision Shortcut Learning in Radiology Report Generation29 Jun 2026
- 2026Effect of Demographic Bias on Skin Lesion Classification2 Jun 2026
- 2026Dataset Diversity Metrics and Impact on Classification Models16 Mar 2026
- 2025Localising Shortcut Learning in Pixel Space via Ordinal Scoring Correlations for Attribution Representations (OSCAR)21 Dec 2025
- 2025meval: A Statistical Toolbox for Fine-Grained Model Performance Analysis19 Dec 2025
- 2025Fairness and Robustness of CLIP-Based Models for Chest X-rays28 Jul 2025
- 2025Subgroup Performance Analysis in Hidden Stratifications13 Mar 2025
- 2024Mask of truth: model sensitivity to unexpected regions of medical images5 Dec 2024
8 more
- 2024Dataset Distribution Impacts Model Fairness: Single vs. Multi-Task Learning24 Jul 2024
- 2024Slicing Through Bias: Explaining Performance Gaps in Medical Image Analysis using Slice Discovery Methods17 Jun 2024
- 2024Shortcut Learning in Medical Image Segmentation11 Mar 2024
- 2024Copycats: the many lives of a publicly available medical imaging dataset9 Feb 2024
- 2023Fast Diffusion-Based Counterfactuals for Shortcut Removal and Generation21 Dec 2023
- 2023Augmenting Chest X-ray Datasets with Non-Expert Annotations5 Sep 2023
- 2023How You Split Matters: Data Leakage and Subject Characteristics Studies in Longitudinal Brain MRI Analysis1 Sep 2023
- 2023Distributionally Robust Optimization and Invariant Representation Learning for Addressing Subgroup Underrepresentation: Mechanisms and Limitations12 Aug 2023
- 2023Fast Diffusion-Based Counterfactuals for Shortcut Removal and Generationcited by 41
- 2024Shortcut Learning in Medical Image Segmentationcited by 16
- 2024Slicing Through Bias: Explaining Performance Gaps in Medical Image Analysis using Slice Discovery Methodscited by 14
- 2023How You Split Matters: Data Leakage and Subject Characteristics Studies in Longitudinal Brain MRI Analysiscited by 8
- 2023Augmenting Chest X-ray Datasets with Non-Expert Annotationscited by 6
- 2024Mask of truth: model sensitivity to unexpected regions of medical imagescited by 6
- 2024Copycats: the many lives of a publicly available medical imaging datasetcited by 5
- 2025Subgroup Performance Analysis in Hidden Stratificationscited by 3
- 2024Dataset Distribution Impacts Model Fairness: Single vs. Multi-Task Learningcited by 2
- 2023Distributionally Robust Optimization and Invariant Representation Learning for Addressing Subgroup Underrepresentation: Mechanisms and Limitationscited by 1
- 2025Fairness and Robustness of CLIP-Based Models for Chest X-rayscited by 1
- 2026Dataset Diversity Metrics and Impact on Classification Modelscited by 1
12 most cited of 18 All 18 (JSON)
- 2026Prevalence calibration as shortcut mitigation7 Sep 2026
- 2026P3CA: Encoder-Agnostic Interpretation of Vision Foundation Model Embeddings via Spatial Probing10 Aug 2026
- 2026ReMoDEx: A Local-to-Global Relevance-Based Model Decision Explainability Framework for large-Scale Image Datasets8 Jul 2026
- 2026Effect of Demographic Bias on Skin Lesion Classification2 Jun 2026
- 2026Dataset Diversity Metrics and Impact on Classification Models16 Mar 2026
- 2025Localising Shortcut Learning in Pixel Space via Ordinal Scoring Correlations for Attribution Representations (OSCAR)21 Dec 2025
- 2025meval: A Statistical Toolbox for Fine-Grained Model Performance Analysis19 Dec 2025
- 2025Fairness and Robustness of CLIP-Based Models for Chest X-rays28 Jul 2025
- 2025Subgroup Performance Analysis in Hidden Stratifications13 Mar 2025
- 2024Mask of truth: model sensitivity to unexpected regions of medical images5 Dec 2024
- 2024Dataset Distribution Impacts Model Fairness: Single vs. Multi-Task Learning24 Jul 2024
- 2024Slicing Through Bias: Explaining Performance Gaps in Medical Image Analysis using Slice Discovery Methods17 Jun 2024
12 newest of 18 All 18 (JSON)