Exploring contrast generalisation in deep learning-based brain MRI-to-CT synthesis
Not on the map. Why?
Abstract (arXiv)
Background: Synthetic computed tomography (sCT) has been proposed and increasingly clinically adopted to enable magnetic resonance imaging (MRI)-based radiotherapy. Deep learning (DL) has recently demonstrated the ability to generate accurate sCT from fixed MRI acquisitions. However, MRI protocols may change over time or differ between centres resulting in low-quality sCT due to poor model generalisation. Purpose: investigating domain randomisation (DR) to increase the generalisation of a DL model for brain sCT generation. Methods: CT and corresponding T1-weighted MRI with/without contrast, T2-weighted, and FLAIR MRI from 95 patients undergoing RT were collected, considering FLAIR the unseen sequence where to investigate generalisation. A ``Baseline'' generative adversarial network was trained with/without the FLAIR sequence to test how a model performs without DR. Image similarity and accuracy of sCT-based dose plans were assessed against CT to select the best-performing DR approach against the Baseline. Results: The Baseline model had the poorest performance on FLAIR, with mean absolute error (MAE)=106±20.7 HU (mean±σ). Performance on FLAIR significantly improved for the DR model with MAE=99.0±14.9 HU, but still inferior to the performance of the Baseline+FLAIR model (MAE=72.6±10.1 HU). Similarly, an improvement in γ-pass rate was obtained for DR vs Baseline. Conclusions: DR improved image similarity and dose accuracy on the unseen sequence compared to training only on acquired MRI. DR makes the model more robust, reducing the need for re-training when applying a model on sequences unseen and unavailable for retraining.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 15 of its 89 references that are in the map. First posted on arXiv 17 Mar 2023.
Builds on
15 of 89 references.
References · 15
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
- 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 292
- 2016Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentationcited by 263
- 2020TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learningcited by 176
- 2019FastSurfer -- A fast and accurate deep learning based neuroimaging pipelinecited by 110
- 2017Deep MR to CT Synthesis using Unpaired Datacited by 86
- 2020A Learning Strategy for Contrast-agnostic MRI Segmentationcited by 35
- 2021Deep learning-based synthetic-CT generation in radiotherapy and PET: a reviewcited by 28
3 more
- 2017Deep Embedding Convolutional Neural Network for Synthesizing CT Image from T1-Weighted MR Imagecited by 9
- 2018Object Detection using Domain Randomization and Generative Adversarial Refinement of Synthetic Imagescited by 4
- 2021Deep learning-based synthetic CT generation from MR images: comparison of generative adversarial and residual neural networkscited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 1.
2 papers.