TBI-GAN: An Adversarial Learning Approach for Data Synthesis on Traumatic Brain Segmentation
Not on the map. Why?
Abstract (arXiv)
Brain network analysis for traumatic brain injury (TBI) patients is critical for its consciousness level assessment and prognosis evaluation, which requires the segmentation of certain consciousness-related brain regions. However, it is difficult to construct a TBI segmentation model as manually annotated MR scans of TBI patients are hard to collect. Data augmentation techniques can be applied to alleviate the issue of data scarcity. However, conventional data augmentation strategies such as spatial and intensity transformation are unable to mimic the deformation and lesions in traumatic brains, which limits the performance of the subsequent segmentation task. To address these issues, we propose a novel medical image inpainting model named TBI-GAN to synthesize TBI MR scans with paired brain label maps. The main strength of our TBI-GAN method is that it can generate TBI images and corresponding label maps simultaneously, which has not been achieved in the previous inpainting methods for medical images. We first generate the inpainted image under the guidance of edge information following a coarse-to-fine manner, and then the synthesized intensity image is used as the prior for label inpainting. Furthermore, we introduce a registration-based template augmentation pipeline to increase the diversity of the synthesized image pairs and enhance the capacity of data augmentation. Experimental results show that the proposed TBI-GAN method can produce sufficient synthesized TBI images with high quality and valid label maps, which can greatly improve the 2D and 3D traumatic brain segmentation performance compared with the alternatives.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 46 references that are in the map. First posted on arXiv 12 Aug 2022.
Builds on
27 of 46 references.
References · 27
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
15 more
- 2016Least Squares Generative Adversarial Networkscited by 1,001
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2015Holistically-Nested Edge Detectioncited by 592
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2019EdgeConnect: Generative Image Inpainting with Adversarial Edge Learningcited by 163
- 2018Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networkscited by 147
- 2019Data augmentation using learned transformations for one-shot medical image segmentationcited by 138
- 2018SPG-Net: Segmentation Prediction and Guidance Network for Image Inpaintingcited by 58
- 20193D Whole Brain Segmentation using Spatially Localized Atlas Network Tilescited by 50
- 2018Learning Data Augmentation for Brain Tumor Segmentation with Coarse-to-Fine Generative Adversarial Networkscited by 15
- 2017Deep Embedding Convolutional Neural Network for Synthesizing CT Image from T1-Weighted MR Imagecited by 9
- 2018Chest X-ray Inpainting with Deep Generative Modelscited by 4
- 2020Robust Brain Magnetic Resonance Image Segmentation for Hydrocephalus Patients: Hard and Soft Attentioncited by 4
Built on by
Citing papers per year: 2023: 1.
1 paper.