Key Technology Considerations in Developing and Deploying Machine Learning Models in Clinical Radiology Practice
Not on the map. Why?
Abstract (arXiv)
The use of machine learning to develop intelligent software tools for interpretation of radiology images has gained widespread attention in recent years. The development, deployment, and eventual adoption of these models in clinical practice, however, remains fraught with challenges. In this paper, we propose a list of key considerations that machine learning researchers must recognize and address to make their models accurate, robust, and usable in practice. Namely, we discuss: insufficient training data, decentralized datasets, high cost of annotations, ambiguous ground truth, imbalance in class representation, asymmetric misclassification costs, relevant performance metrics, generalization of models to unseen datasets, model decay, adversarial attacks, explainability, fairness and bias, and clinical validation. We describe each consideration and identify techniques to address it. Although these techniques have been discussed in prior research literature, by freshly examining them in the context of medical imaging and compiling them in the form of a laundry list, we hope to make them more accessible to researchers, software developers, radiologists, and other stakeholders.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 56 of its 128 references that are in the map. First posted on arXiv 3 Feb 2021.
Builds on
56 of 128 references.
References · 56
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2013Intriguing properties of neural networkscited by 5,114
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2017Adversarial Discriminative Domain Adaptationcited by 1,309
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
38 more
- 2017Evasion Attacks against Machine Learning at Test Timecited by 686
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 675
- 2018Deep Visual Domain Adaptation: A Surveycited by 634
- 2013Domain Generalization via Invariant Feature Representationcited by 622
- 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 590
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 484
- 2018Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Surveycited by 459
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2017On Fairness and Calibrationcited by 406
- 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 405
- 2017Deep Learning for Medical Image Analysiscited by 399
- 2018Split learning for health: Distributed deep learning without sharing raw patient datacited by 391
- 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 374
- 2016Unsupervised Domain Adaptation with Residual Transfer Networkscited by 340
- 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 329
- 2016Domain Separation Networkscited by 317
- 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
- 2017Certified Defenses for Data Poisoning Attackscited by 288
- 2018Adversarial Attacks and Defences: A Surveycited by 259
- 2018Generative Adversarial Network in Medical Imaging: A Reviewcited by 257
- 2017PixelDefend: Leveraging Generative Models to Understand and Defend against Adversarial Examplescited by 243
- 2017Improving the Adversarial Robustness and Interpretability of Deep Neural Networks by Regularizing their Input Gradientscited by 236
- 2017On Detecting Adversarial Perturbationscited by 232
- 2018Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysiscited by 178
- 2014Towards Deep Neural Network Architectures Robust to Adversarial Examplescited by 146
- 2020Survey of Personalization Techniques for Federated Learningcited by 144
- 2019Domain Agnostic Learning with Disentangled Representationscited by 107
- 2019Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A Surveycited by 93
- 2018Model Reconstruction from Model Explanationscited by 84
- 2020Secure and Robust Machine Learning for Healthcare: A Surveycited by 77
- 2017SafetyNet: Detecting and Rejecting Adversarial Examples Robustlycited by 76
- 2015Learning with a Strong Adversarycited by 68
- 2018Comparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classificationcited by 57
- 2019Can we trust deep learning models diagnosis? The impact of domain shift in chest radiograph classificationcited by 57
- 2017Adversarial Examples, Uncertainty, and Transfer Testing Robustness in Gaussian Process Hybrid Deep Networkscited by 48
- 2019Machine Learning with Multi-Site Imaging Data: An Empirical Study on the Impact of Scanner Effectscited by 40
- 2020Semi-supervised few-shot learning for medical image segmentationcited by 34
- 2017A Systematic Study of Online Class Imbalance Learning with Concept Driftcited by 28
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 0; 2024: 2; 2025: 1.
6 papers.
- 2024A Closer Look at AUROC and AUPRC under Class Imbalancecited by 56
- 2022A Classical-Quantum Convolutional Neural Network for Detecting Pneumonia from Chest Radiographscited by 6
- 2024Empirical investigation of multi-source cross-validation in clinical ECG classificationcited by 2
- 2021Levels of Autonomous Radiologycited by 0
- 2022Creating awareness about security and safety on highways to mitigate wildlife-vehicle collisions by detecting and recognizing wildlife fences using deep learning and drone technologycited by 0
- 2025Agent-Based Output Drift Detection for Breast Cancer Response Prediction in a Multisite Clinical Decision Support Systemcited by 0
- 2025Agent-Based Output Drift Detection for Breast Cancer Response Prediction in a Multisite Clinical Decision Support System20 Dec 2025
- 2024Empirical investigation of multi-source cross-validation in clinical ECG classification22 Mar 2024
- 2024A Closer Look at AUROC and AUPRC under Class Imbalance11 Jan 2024
- 2022Creating awareness about security and safety on highways to mitigate wildlife-vehicle collisions by detecting and recognizing wildlife fences using deep learning and drone technology22 Dec 2022
- 2022A Classical-Quantum Convolutional Neural Network for Detecting Pneumonia from Chest Radiographs19 Feb 2022
- 2021Levels of Autonomous Radiology14 Dec 2021