Challenges for machine learning in clinical translation of big data imaging studies
Not on the map. Why?
Abstract (arXiv)
The combination of deep learning image analysis methods and large-scale imaging datasets offers many opportunities to imaging neuroscience and epidemiology. However, despite the success of deep learning when applied to many neuroimaging tasks, there remain barriers to the clinical translation of large-scale datasets and processing tools. Here, we explore the main challenges and the approaches that have been explored to overcome them. We focus on issues relating to data availability, interpretability, evaluation and logistical challenges, and discuss the challenges we believe are still to be overcome to enable the full success of big data deep learning approaches to be experienced outside of the research field.
Key facts. Cited by 15 papers in the map (data through 13 Oct 2026). Builds on 90 of its 212 references that are in the map. First posted on arXiv 7 Jul 2021.
Builds on
90 of 212 references.
References · 90
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
- 2015Distilling the Knowledge in a Neural Networkcited by 10,180
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,991
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,713
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,170
- 2017Squeeze-and-Excitation Networkscited by 4,772
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,730
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,430
- 2017Axiomatic Attribution for Deep Networkscited by 3,368
- 2015Domain-Adversarial Training of Neural Networkscited by 3,030
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,862
38 more
- 2016Deep Learning with Differential Privacycited by 2,718
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,360
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,340
- 2017Non-local Neural Networkscited by 2,291
- 2014Conditional Generative Adversarial Netscited by 2,157
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,475
- 2014How transferable are features in deep neural networks?cited by 1,219
- 2018Sanity Checks for Saliency Mapscited by 1,152
- 2016Pruning Filters for Efficient ConvNetscited by 1,138
- 2016Practical Black-Box Attacks against Machine Learningcited by 902
- 2017Deep Bayesian Active Learning with Image Datacited by 816
- 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 673
- 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 639
- 2020The Future of Digital Health with Federated Learningcited by 630
- 2018Do Better ImageNet Models Transfer Better?cited by 562
- 2018Rethinking ImageNet Pre-trainingcited by 377
- 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
- 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 280
- 2018Attention Gated Networks: Learning to Leverage Salient Regions in Medical Imagescited by 271
- 2016Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentationcited by 263
- 2019Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentationcited by 259
- 2018Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learningcited by 246
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2020Deep Structural Causal Models for Tractable Counterfactual Inferencecited by 210
- 2015Simultaneous Deep Transfer Across Domains and Taskscited by 205
- 2018Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysiscited by 178
- 2020TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learningcited by 177
- 2018BAM: Bottleneck Attention Modulecited by 172
- 2019Privacy-preserving Federated Brain Tumour Segmentationcited by 169
- 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
- 2018Multi-Institutional Deep Learning Modeling Without Sharing Patient Data: A Feasibility Study on Brain Tumor Segmentationcited by 149
- 2017Suggestive Annotation: A Deep Active Learning Framework for Biomedical Image Segmentationcited by 145
- 2019PHiSeg: Capturing Uncertainty in Medical Image Segmentationcited by 128
- 2017Data Distillation: Towards Omni-Supervised Learningcited by 126
- 2016Unsupervised domain adaptation in brain lesion segmentation with adversarial networkscited by 125
- 2019FastSurfer -- A fast and accurate deep learning based neuroimaging pipelinecited by 110
- 2018Unsupervised domain adaptation for medical imaging segmentation with self-ensemblingcited by 94
50 most cited of 90 All 90 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 5; 2024: 2; 2025: 4; 2026: 1.
15 papers.
Sort:
- 2023SwiFT: Swin 4D fMRI Transformercited by 36
- 2023MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learningcited by 7
- 2025Dynamical Modeling of Behaviorally Relevant Spatiotemporal Patterns in Neural Imaging Datacited by 6
- 2022Uncertainty categories in medical image segmentation: a study of source-related diversitycited by 4
- 2023DOMINO++: Domain-aware Loss Regularization for Deep Learning Generalizabilitycited by 3
- 2021Automatic quality control framework for more reliable integration of machine learning-based image segmentation into medical workflowscited by 1
- 2022Computer-Aided Extraction of Select MRI Markers of Cerebral Small Vessel Disease: A Systematic Reviewcited by 1
- 2024Automated quality assessment using appearance-based simulations and hippocampus segmentation on low-field paediatric brain MR imagescited by 1
- 2026Cross-Subject Modeling for Widefield Calcium Imaging via Atlas-Aligned Spatiotemporal Tokenizationcited by 1
- 2023SFHarmony: Source Free Domain Adaptation for Distributed Neuroimaging Analysiscited by 0
- 2023Prototype Learning for Explainable Brain Age Predictioncited by 0
- 2024Subgraph Clustering and Atom Learning for Improved Image Classificationcited by 0
3 more
- 2025Resolution Invariant Autoencodercited by 0
- 2025ColonScopeX: Leveraging Explainable Expert Systems with Multimodal Data for Improved Early Diagnosis of Colorectal Cancercited by 0
- 2025Performance Estimation for Supervised Medical Image Segmentation Models on Unlabeled Data Using UniverSegcited by 0
- 2026Cross-Subject Modeling for Widefield Calcium Imaging via Atlas-Aligned Spatiotemporal Tokenization5 Jul 2026
- 2025Dynamical Modeling of Behaviorally Relevant Spatiotemporal Patterns in Neural Imaging Data23 Sep 2025
- 2025Performance Estimation for Supervised Medical Image Segmentation Models on Unlabeled Data Using UniverSeg22 Apr 2025
- 2025ColonScopeX: Leveraging Explainable Expert Systems with Multimodal Data for Improved Early Diagnosis of Colorectal Cancer9 Apr 2025
- 2025Resolution Invariant Autoencoder12 Mar 2025
- 2024Automated quality assessment using appearance-based simulations and hippocampus segmentation on low-field paediatric brain MR images8 Oct 2024
- 2024Subgraph Clustering and Atom Learning for Improved Image Classification20 Jul 2024
- 2023MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning22 Dec 2023
- 2023DOMINO++: Domain-aware Loss Regularization for Deep Learning Generalizability21 Aug 2023
- 2023SwiFT: Swin 4D fMRI Transformer12 Jul 2023
- 2023Prototype Learning for Explainable Brain Age Prediction16 Jun 2023
- 2023SFHarmony: Source Free Domain Adaptation for Distributed Neuroimaging Analysis28 Mar 2023
3 more
- 2022Computer-Aided Extraction of Select MRI Markers of Cerebral Small Vessel Disease: A Systematic Review4 Apr 2022
- 2022Uncertainty categories in medical image segmentation: a study of source-related diversity1 Mar 2022
- 2021Automatic quality control framework for more reliable integration of machine learning-based image segmentation into medical workflows6 Dec 2021
- 2023SwiFT: Swin 4D fMRI Transformercited by 36
- 2023MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learningcited by 7
- 2025Dynamical Modeling of Behaviorally Relevant Spatiotemporal Patterns in Neural Imaging Datacited by 6
- 2022Uncertainty categories in medical image segmentation: a study of source-related diversitycited by 4
- 2023DOMINO++: Domain-aware Loss Regularization for Deep Learning Generalizabilitycited by 3
- 2021Automatic quality control framework for more reliable integration of machine learning-based image segmentation into medical workflowscited by 1
- 2022Computer-Aided Extraction of Select MRI Markers of Cerebral Small Vessel Disease: A Systematic Reviewcited by 1
- 2024Automated quality assessment using appearance-based simulations and hippocampus segmentation on low-field paediatric brain MR imagescited by 1
- 2026Cross-Subject Modeling for Widefield Calcium Imaging via Atlas-Aligned Spatiotemporal Tokenizationcited by 1
- 2023SFHarmony: Source Free Domain Adaptation for Distributed Neuroimaging Analysiscited by 0
- 2023Prototype Learning for Explainable Brain Age Predictioncited by 0
- 2024Subgraph Clustering and Atom Learning for Improved Image Classificationcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Cross-Subject Modeling for Widefield Calcium Imaging via Atlas-Aligned Spatiotemporal Tokenization5 Jul 2026
- 2025Dynamical Modeling of Behaviorally Relevant Spatiotemporal Patterns in Neural Imaging Data23 Sep 2025
- 2025Performance Estimation for Supervised Medical Image Segmentation Models on Unlabeled Data Using UniverSeg22 Apr 2025
- 2025ColonScopeX: Leveraging Explainable Expert Systems with Multimodal Data for Improved Early Diagnosis of Colorectal Cancer9 Apr 2025
- 2025Resolution Invariant Autoencoder12 Mar 2025
- 2024Automated quality assessment using appearance-based simulations and hippocampus segmentation on low-field paediatric brain MR images8 Oct 2024
- 2024Subgraph Clustering and Atom Learning for Improved Image Classification20 Jul 2024
- 2023MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning22 Dec 2023
- 2023DOMINO++: Domain-aware Loss Regularization for Deep Learning Generalizability21 Aug 2023
- 2023SwiFT: Swin 4D fMRI Transformer12 Jul 2023
- 2023Prototype Learning for Explainable Brain Age Prediction16 Jun 2023
- 2023SFHarmony: Source Free Domain Adaptation for Distributed Neuroimaging Analysis28 Mar 2023
12 newest of 15 All 15 (JSON)