A Systematic Review of Generalization Research in Medical Image Classification
Not on the map. Why?
Abstract (arXiv)
Numerous Deep Learning (DL) classification models have been developed for a large spectrum of medical image analysis applications, which promises to reshape various facets of medical practice. Despite early advances in DL model validation and implementation, which encourage healthcare institutions to adopt them, a fundamental questions remain: how can these models effectively handle domain shift? This question is crucial to limit DL models performance degradation. Medical data are dynamic and prone to domain shift, due to multiple factors. Two main shift types can occur over time: 1) covariate shift mainly arising due to updates to medical equipment and 2) concept shift caused by inter-grader variability. To mitigate the problem of domain shift, existing surveys mainly focus on domain adaptation techniques, with an emphasis on covariate shift. More generally, no work has reviewed the state-of-the-art solutions while focusing on the shift types. This paper aims to explore existing domain generalization methods for DL-based classification models through a systematic review of literature. It proposes a taxonomy based on the shift type they aim to solve. Papers were searched and gathered on Scopus till 10 April 2023, and after the eligibility screening and quality evaluation, 77 articles were identified. Exclusion criteria included: lack of methodological novelty (e.g., reviews, benchmarks), experiments conducted on a single mono-center dataset, or articles not written in English. The results of this paper show that learning based methods are emerging, for both shift types. Finally, we discuss future challenges, including the need for improved evaluation protocols and benchmarks, and envisioned future developments to achieve robust, generalized models for medical image classification.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 123 of its 232 references that are in the map. First posted on arXiv 18 Mar 2024.
Builds on
123 of 232 references.
References · 123
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2020Supervised Contrastive Learningcited by 2,829
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
38 more
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
- 2020In Search of Lost Domain Generalizationcited by 1,054
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 920
- 2020What Makes for Good Views for Contrastive Learning?cited by 846
- 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 808
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
- 2021Domain Generalization: A Surveycited by 764
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
- 2018End-to-End Incremental Learningcited by 597
- 2021Domain Generalization with MixStylecited by 566
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 436
- 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 434
- 2018Rotation Equivariant CNNs for Digital Pathologycited by 422
- 2019Confident Learning: Estimating Uncertainty in Dataset Labelscited by 413
- 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 407
- 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 379
- 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 352
- 2019Semi-supervised Domain Adaptation via Minimax Entropycited by 335
- 2020Keystroke Dynamics as Part of Lifeloggingcited by 334
- 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 309
- 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 294
- 2016Revisiting Batch Normalization For Practical Domain Adaptationcited by 288
- 2023A Cookbook of Self-Supervised Learningcited by 250
- 2016Data Programming: Creating Large Training Sets, Quicklycited by 246
- 2020A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promisescited by 231
- 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 227
- 2019Probabilistic End-to-end Noise Correction for Learning with Noisy Labelscited by 210
- 2019Understanding and Utilizing Deep Neural Networks Trained with Noisy Labelscited by 209
- 2016Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challengecited by 201
- 2020Can AI help in screening Viral and COVID-19 pneumonia?cited by 200
50 most cited of 123 All 123 (JSON)
Built on by
Citing papers per year: 2025: 5; 2026: 3.
8 papers.
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Reviewcited by 8
- 2025Deep Learning for Retinal Degeneration Assessment: A Comprehensive Analysis of the MARIO Challengecited by 1
- 2026Beyond Random Partitioning: Unsupervised Spatio-Temporal Stratification for Cohort Balancing in Longitudinal Medical Imagingcited by 1
- 2025Color-Quality Invariance for Robust Medical Image Segmentationcited by 0
- 2025WeCKD: Weakly-supervised Chained Distillation Network for Efficient Multimodal Medical Imagingcited by 0
- 2025Generative deep learning for foundational video translation in ultrasoundcited by 0
- 2026K-MaT: Knowledge-Anchored Manifold Transport for Cross-Modal Prompt Learning in Medical Imagingcited by 0
- 2026Constrained latent state modeling: A unifying perspective on representation learning under competing constraintscited by 0
- 2026Beyond Random Partitioning: Unsupervised Spatio-Temporal Stratification for Cohort Balancing in Longitudinal Medical Imaging29 Jul 2026
- 2026Constrained latent state modeling: A unifying perspective on representation learning under competing constraints15 May 2026
- 2026K-MaT: Knowledge-Anchored Manifold Transport for Cross-Modal Prompt Learning in Medical Imaging6 Mar 2026
- 2025Generative deep learning for foundational video translation in ultrasound5 Nov 2025
- 2025WeCKD: Weakly-supervised Chained Distillation Network for Efficient Multimodal Medical Imaging16 Oct 2025
- 2025Deep Learning for Retinal Degeneration Assessment: A Comprehensive Analysis of the MARIO Challenge3 Jun 2025
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Review16 Feb 2025
- 2025Color-Quality Invariance for Robust Medical Image Segmentation11 Feb 2025