mlsanityData to 7 Oct 2026

Key Technology Considerations in Developing and Deploying Machine Learning Models in Clinical Radiology Practice

arXiv 2102.01979 ↗First posted 3 Feb 2021cs.LG cs.CYcited by 6

Not on the map. Why?

Abstract (arXiv)

The use of machine learning to develop intelligent software tools for interpretation of radiology images has gained widespread attention in recent years. The development, deployment, and eventual adoption of these models in clinical practice, however, remains fraught with challenges. In this paper, we propose a list of key considerations that machine learning researchers must recognize and address to make their models accurate, robust, and usable in practice. Namely, we discuss: insufficient training data, decentralized datasets, high cost of annotations, ambiguous ground truth, imbalance in class representation, asymmetric misclassification costs, relevant performance metrics, generalization of models to unseen datasets, model decay, adversarial attacks, explainability, fairness and bias, and clinical validation. We describe each consideration and identify techniques to address it. Although these techniques have been discussed in prior research literature, by freshly examining them in the context of medical imaging and compiling them in the form of a laundry list, we hope to make them more accessible to researchers, software developers, radiologists, and other stakeholders.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 56 of its 128 references that are in the map. First posted on arXiv 3 Feb 2021.

Builds on

56 of 128 references.

References · 56

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  2. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  4. 2013Intriguing properties of neural networkscited by 5,114
  5. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  6. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  7. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  8. 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
  9. 2017Adversarial Discriminative Domain Adaptationcited by 1,309
  10. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  11. 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
  12. 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
38 more
  1. 2017Evasion Attacks against Machine Learning at Test Timecited by 686
  2. 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 675
  3. 2018Deep Visual Domain Adaptation: A Surveycited by 634
  4. 2013Domain Generalization via Invariant Feature Representationcited by 622
  5. 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 590
  6. 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 484
  7. 2018Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Surveycited by 459
  8. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  9. 2017On Fairness and Calibrationcited by 406
  10. 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 405
  11. 2017Deep Learning for Medical Image Analysiscited by 399
  12. 2018Split learning for health: Distributed deep learning without sharing raw patient datacited by 391
  13. 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 374
  14. 2016Unsupervised Domain Adaptation with Residual Transfer Networkscited by 340
  15. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 329
  16. 2016Domain Separation Networkscited by 317
  17. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
  18. 2017Certified Defenses for Data Poisoning Attackscited by 288
  19. 2018Adversarial Attacks and Defences: A Surveycited by 259
  20. 2018Generative Adversarial Network in Medical Imaging: A Reviewcited by 257
  21. 2017PixelDefend: Leveraging Generative Models to Understand and Defend against Adversarial Examplescited by 243
  22. 2017Improving the Adversarial Robustness and Interpretability of Deep Neural Networks by Regularizing their Input Gradientscited by 236
  23. 2017On Detecting Adversarial Perturbationscited by 232
  24. 2018Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysiscited by 178
  25. 2014Towards Deep Neural Network Architectures Robust to Adversarial Examplescited by 146
  26. 2020Survey of Personalization Techniques for Federated Learningcited by 144
  27. 2019Domain Agnostic Learning with Disentangled Representationscited by 107
  28. 2019Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A Surveycited by 93
  29. 2018Model Reconstruction from Model Explanationscited by 84
  30. 2020Secure and Robust Machine Learning for Healthcare: A Surveycited by 77
  31. 2017SafetyNet: Detecting and Rejecting Adversarial Examples Robustlycited by 76
  32. 2015Learning with a Strong Adversarycited by 68
  33. 2018Comparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classificationcited by 57
  34. 2019Can we trust deep learning models diagnosis? The impact of domain shift in chest radiograph classificationcited by 57
  35. 2017Adversarial Examples, Uncertainty, and Transfer Testing Robustness in Gaussian Process Hybrid Deep Networkscited by 48
  36. 2019Machine Learning with Multi-Site Imaging Data: An Empirical Study on the Impact of Scanner Effectscited by 40
  37. 2020Semi-supervised few-shot learning for medical image segmentationcited by 34
  38. 2017A Systematic Study of Online Class Imbalance Learning with Concept Driftcited by 28

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 2; 2023: 0; 2024: 2; 2025: 1.

6 papers.