mlsanityData to 14 Oct 2026

A Systematic Review of Generalization Research in Medical Image Classification

arXiv 2403.12167 ↗First posted 18 Mar 2024eess.IV cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Numerous Deep Learning (DL) classification models have been developed for a large spectrum of medical image analysis applications, which promises to reshape various facets of medical practice. Despite early advances in DL model validation and implementation, which encourage healthcare institutions to adopt them, a fundamental questions remain: how can these models effectively handle domain shift? This question is crucial to limit DL models performance degradation. Medical data are dynamic and prone to domain shift, due to multiple factors. Two main shift types can occur over time: 1) covariate shift mainly arising due to updates to medical equipment and 2) concept shift caused by inter-grader variability. To mitigate the problem of domain shift, existing surveys mainly focus on domain adaptation techniques, with an emphasis on covariate shift. More generally, no work has reviewed the state-of-the-art solutions while focusing on the shift types. This paper aims to explore existing domain generalization methods for DL-based classification models through a systematic review of literature. It proposes a taxonomy based on the shift type they aim to solve. Papers were searched and gathered on Scopus till 10 April 2023, and after the eligibility screening and quality evaluation, 77 articles were identified. Exclusion criteria included: lack of methodological novelty (e.g., reviews, benchmarks), experiments conducted on a single mono-center dataset, or articles not written in English. The results of this paper show that learning based methods are emerging, for both shift types. Finally, we discuss future challenges, including the need for improved evaluation protocols and benchmarks, and envisioned future developments to achieve robust, generalized models for medical image classification.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 123 of its 232 references that are in the map. First posted on arXiv 18 Mar 2024.

Builds on

123 of 232 references.

References · 123

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  3. 2020End-to-End Object Detection with Transformerscited by 7,414
  4. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  5. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  6. 2020Supervised Contrastive Learningcited by 2,829
  7. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  8. 2016Matching Networks for One Shot Learningcited by 2,255
  9. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  10. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
  11. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
  12. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
38 more
  1. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
  2. 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
  3. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
  4. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
  5. 2020In Search of Lost Domain Generalizationcited by 1,054
  6. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
  7. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
  8. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
  9. 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 920
  10. 2020What Makes for Good Views for Contrastive Learning?cited by 846
  11. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 808
  12. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
  13. 2021Domain Generalization: A Surveycited by 764
  14. 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
  15. 2018End-to-End Incremental Learningcited by 597
  16. 2021Domain Generalization with MixStylecited by 566
  17. 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
  18. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
  19. 2021Towards Out-Of-Distribution Generalization: A Surveycited by 436
  20. 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 434
  21. 2018Rotation Equivariant CNNs for Digital Pathologycited by 422
  22. 2019Confident Learning: Estimating Uncertainty in Dataset Labelscited by 413
  23. 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 407
  24. 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 379
  25. 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 352
  26. 2019Semi-supervised Domain Adaptation via Minimax Entropycited by 335
  27. 2020Keystroke Dynamics as Part of Lifeloggingcited by 334
  28. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 309
  29. 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 294
  30. 2016Revisiting Batch Normalization For Practical Domain Adaptationcited by 288
  31. 2023A Cookbook of Self-Supervised Learningcited by 250
  32. 2016Data Programming: Creating Large Training Sets, Quicklycited by 246
  33. 2020A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promisescited by 231
  34. 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 227
  35. 2019Probabilistic End-to-end Noise Correction for Learning with Noisy Labelscited by 210
  36. 2019Understanding and Utilizing Deep Neural Networks Trained with Noisy Labelscited by 209
  37. 2016Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challengecited by 201
  38. 2020Can AI help in screening Viral and COVID-19 pneumonia?cited by 200

50 most cited of 123 All 123 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 3.

8 papers.