Reproducibility in machine learning for medical imaging
Not on the map. Why?
Abstract (arXiv)
Reproducibility is a cornerstone of science, as the replication of findings is the process through which they become knowledge. It is widely considered that many fields of science are undergoing a reproducibility crisis. This has led to the publications of various guidelines in order to improve research reproducibility. This didactic chapter intends at being an introduction to reproducibility for researchers in the field of machine learning for medical imaging. We first distinguish between different types of reproducibility. For each of them, we aim at defining it, at describing the requirements to achieve it and at discussing its utility. The chapter ends with a discussion on the benefits of reproducibility and with a plea for a non-dogmatic approach to this concept and its implementation in research practice.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 12 of its 82 references that are in the map. First posted on arXiv 12 Sep 2022.
Builds on
12 of 82 references.
References · 12
- 2016Deep Learning with Differential Privacycited by 2,682
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 318
- 2021Accounting for Variance in Machine Learning Benchmarkscited by 195
- 2019Convolutional Neural Networks for Classification of Alzheimer's Disease: Overview and Reproducible Evaluationcited by 106
- 2017Cross-validation failure: small sample sizes lead to large error barscited by 41
- 2019Reproducibility in Machine Learning for Healthcited by 24
- 2020pymia: A Python package for data handling and evaluation in deep learning-based medical image analysiscited by 16
- 2018Reproducible evaluation of classification methods in Alzheimer's disease: framework and application to MRI and PET datacited by 14
- 2021Automatic quality control of brain T1-weighted magnetic resonance images for a clinical data warehousecited by 8
- 2021The MICCAI Hackathon on reproducibility, diversity, and selection of papers at the MICCAI conferencecited by 3
- 2020Medical imaging data structure extended to multiple modalities and anatomical regionscited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 0; 2026: 2.
5 papers.
- 2023Reproducibility in Machine Learning-Driven Researchcited by 15
- 2024Comparative Analysis of ImageNet Pre-Trained Deep Learning Models and DINOv2 in Medical Imaging Classificationcited by 13
- 2023Confidence Intervals for Performance Estimates in Brain MRI Segmentationcited by 1
- 2026Reliable Benchmarking of Artifact Detection in Computational Pathology: A Reproducibility and Uncertainty Analysiscited by 1
- 2026Radiuma: A Unified Zero-Code Executable Graphical Workflow Generator for Reproducible and Shareable Medical Image Analysis and Machine Learningcited by 0
- 2026Reliable Benchmarking of Artifact Detection in Computational Pathology: A Reproducibility and Uncertainty Analysis31 Aug 2026
- 2026Radiuma: A Unified Zero-Code Executable Graphical Workflow Generator for Reproducible and Shareable Medical Image Analysis and Machine Learning22 May 2026
- 2024Comparative Analysis of ImageNet Pre-Trained Deep Learning Models and DINOv2 in Medical Imaging Classification12 Feb 2024
- 2023Confidence Intervals for Performance Estimates in Brain MRI Segmentation20 Jul 2023
- 2023Reproducibility in Machine Learning-Driven Research19 Jul 2023