mlsanityData to 7 Oct 2026

Comprehensive analysis of synthetic learning applied to neonatal brain MRI segmentation

arXiv 2309.05306 ↗First posted 11 Sep 2023stat.MLcited by 7

Not on the map. Why?

Abstract (arXiv)

Brain segmentation from neonatal MRI images is a very challenging task due to large changes in the shape of cerebral structures and variations in signal intensities reflecting the gestational process. In this context, there is a clear need for segmentation techniques that are robust to variations in image contrast and to the spatial configuration of anatomical structures. In this work, we evaluate the potential of synthetic learning, a contrast-independent model trained using synthetic images generated from the ground truth labels of very few subjects.We base our experiments on the dataset released by the developmental Human Connectome Project, for which high-quality T1- and T2-weighted images are available for more than 700 babies aged between 26 and 45 weeks post-conception. First, we confirm the impressive performance of a standard Unet trained on a few T2-weighted volumes, but also confirm that such models learn intensity-related features specific to the training domain. We then evaluate the synthetic learning approach and confirm its robustness to variations in image contrast by reporting the capacity of such a model to segment both T1- and T2-weighted images from the same individuals. However, we observe a clear influence of the age of the baby on the predictions. We improve the performance of this model by enriching the synthetic training set with realistic motion artifacts and over-segmentation of the white matter. Based on extensive visual assessment, we argue that the better performance of the model trained on real T2w data may be due to systematic errors in the ground truth. We propose an original experiment combining two definitions of the ground truth allowing us to show that learning from real data will reproduce any systematic bias from the training set, while synthetic models can avoid this limitation. Overall, our experiments confirm that synthetic learning is an effective solution for segmenting neonatal brain MRI. Our adapted synthetic learning approach combines key features that will be instrumental for large multi-site studies and clinical applications.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 17 of its 42 references that are in the map. First posted on arXiv 11 Sep 2023.

Builds on

17 of 42 references.

References · 17

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  3. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  4. 2021Domain Generalization: A Surveycited by 760
  5. 2022MONAI: An open-source framework for deep learning in healthcarecited by 438
  6. 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 292
  7. 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 235
  8. 2020TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learningcited by 176
  9. 2019Data augmentation using learned transformations for one-shot medical image segmentationcited by 138
  10. 2016Unsupervised domain adaptation in brain lesion segmentation with adversarial networkscited by 125
  11. 2019Synergistic Image and Feature Adaptation: Towards Cross-Modality Domain Adaptation for Medical Image Segmentationcited by 121
  12. 2021Causality-inspired Single-source Domain Generalization for Medical Image Segmentationcited by 118
5 more
  1. 2018Translating and Segmenting Multimodal Medical Volumes with Cycle- and Shape-Consistency Generative Adversarial Networkcited by 97
  2. 2022Robust machine learning segmentation for large-scale analysis of heterogeneous clinical brain MRI datasetscited by 50
  3. 2018A Lifelong Learning Approach to Brain MR Segmentation Across Scanners and Protocolscited by 49
  4. 2020A Learning Strategy for Contrast-agnostic MRI Segmentationcited by 35
  5. 2021Self-Supervised Generative Style Transfer for One-Shot Medical Image Segmentationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 2; 2026: 2.

7 papers.