Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge
Not on the map. Why?
Abstract (arXiv)
Quantitative analysis of brain tumors is critical for clinical decision making. While manual segmentation is tedious, time consuming and subjective, this task is at the same time very challenging to solve for automatic segmentation methods. In this paper we present our most recent effort on developing a robust segmentation algorithm in the form of a convolutional neural network. Our network architecture was inspired by the popular U-Net and has been carefully modified to maximize brain tumor segmentation performance. We use a dice loss function to cope with class imbalances and use extensive data augmentation to successfully prevent overfitting. Our method beats the current state of the art on BraTS 2015, is one of the leading methods on the BraTS 2017 validation set (dice scores of 0.896, 0.797 and 0.732 for whole tumor, tumor core and enhancing tumor, respectively) and achieves very good Dice scores on the test set (0.858 for whole, 0.775 for core and 0.647 for enhancing tumor). We furthermore take part in the survival prediction subchallenge by training an ensemble of a random forest regressor and multilayer perceptrons on shape features describing the tumor subregions. Our approach achieves 52.6% accuracy, a Spearman correlation coefficient of 0.496 and a mean square error of 209607 on the test set.
Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 12; 2023: 10; 2024: 9; 2025: 1; 2026: 1.
56 papers.
Sort:
- 2022Medical Image Segmentation Review: The success of U-Netcited by 190
- 2021TransMed: Transformers Advance Multi-modal Medical Image Classificationcited by 85
- 2021A Deep-Learning Approach For Direct Whole-Heart Mesh Reconstructioncited by 47
- 2021Latent Correlation Representation Learning for Brain Tumor Segmentation with Missing MRI Modalitiescited by 42
- 2022On Calibrating Semantic Segmentation Models: Analyses and An Algorithmcited by 25
- 2024A review of deep learning-based information fusion techniques for multimodal medical image classificationcited by 25
- 2022Cross-Modality Deep Feature Learning for Brain Tumor Segmentationcited by 22
- 2024Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directionscited by 17
- 2023Mirror U-Net: Marrying Multimodal Fission with Multi-task Learning for Semantic Segmentation in Medical Imagingcited by 14
- 2021Feature-enhanced Generation and Multi-modality Fusion based Deep Neural Network for Brain Tumor Segmentation with Missing MR Modalitiescited by 13
- 2022Label fusion and training methods for reliable representation of inter-rater uncertaintycited by 13
- 2022Point-Unet: A Context-aware Point-based Neural Network for Volumetric Segmentationcited by 11
38 more
- 2022Multimodal Information Fusion for Glaucoma and DR Classificationcited by 11
- 2021A Tri-attention Fusion Guided Multi-modal Segmentation Networkcited by 10
- 2022Inflating 2D Convolution Weights for Efficient Generation of 3D Medical Imagescited by 8
- 2021CAN3D: Fast 3D Medical Image Segmentation via Compact Context Aggregationcited by 7
- 2021Glioblastoma Multiforme Prognosis: MRI Missing Modality Generation, Segmentation and Radiogenomic Survival Predictioncited by 5
- 2021Leveraging Human Selective Attention for Medical Image Analysis with Limited Training Datacited by 5
- 2021Cherry-Picking Gradients: Learning Low-Rank Embeddings of Visual Data via Differentiable Cross-Approximationcited by 4
- 2022Application of belief functions to medical image segmentation: A reviewcited by 4
- 20213D Medical Multi-modal Segmentation Network Guided by Multi-source Correlation Constraintcited by 3
- 2023Exploiting Partial Common Information Microstructure for Multi-Modal Brain Tumor Segmentationcited by 3
- 2024AgileFormer: Spatially Agile Transformer UNet for Medical Image Segmentationcited by 3
- 2021Glioblastoma Multiforme Patient Survival Predictioncited by 2
- 2021Deep and Statistical Learning in Biomedical Imaging: State of the Art in 3D MRI Brain Tumor Segmentationcited by 2
- 2021Artificial Intelligence in Tumor Subregion Analysis Based on Medical Imaging: A Reviewcited by 2
- 2021Brain tumour segmentation using a triplanar ensemble of U-Netscited by 2
- 2021Distributing Deep Learning Hyperparameter Tuning for 3D Medical Image Segmentationcited by 2
- 2022A Novel Mask R-CNN Model to Segment Heterogeneous Brain Tumors through Image Subtractioncited by 2
- 2023A Novel Collaborative Self-Supervised Learning Method for Radiomic Datacited by 2
- 2024Automatic Prediction of Stroke Treatment Outcomes: Latest Advances and Perspectivescited by 2
- 2021MRI Images, Brain Lesions and Deep Learningcited by 1
- 2021A Survey and Analysis on Automated Glioma Brain Tumor Segmentation and Overall Patient Survival Predictioncited by 1
- 2021Multi-Domain Learning by Meta-Learning: Taking Optimal Steps in Multi-Domain Loss Landscapes by Inner-Loop Learningcited by 1
- 2021Predicting survival of glioblastoma from automatic whole-brain and tumor segmentation of MR imagescited by 1
- 2023Acute ischemic stroke lesion segmentation in non-contrast CT images using 3D convolutional neural networkscited by 1
- 20233D Brainformer: 3D Fusion Transformer for Brain Tumor Segmentationcited by 1
- 2021Morphological Operation Residual Blocks: Enhancing 3D Morphological Feature Representation in Convolutional Neural Networks for Semantic Segmentation of Medical Imagescited by 0
- 2021Generative Models Improve Radiomics Performance in Different Tasks and Different Datasets: An Experimental Studycited by 0
- 2021An Automatic Detection Method Of Cerebral Aneurysms In Time-Of-Flight Magnetic Resonance Angiography Images Based On Attention 3D U-Netcited by 0
- 2021Deep Learning-based Segmentation of Cerebral Aneurysms in 3D TOF-MRA using Coarse-to-Fine Frameworkcited by 0
- 2022Joint brain tumor segmentation from multi MR sequences through a deep convolutional neural networkcited by 0
- 2022Recursive 3D Segmentation of Shoulder Joint with Coarse-scanned MR Imagecited by 0
- 2022Automated anomaly-aware 3D segmentation of bones and cartilages in knee MR images from the Osteoarthritis Initiativecited by 0
- 2023Spatial Layout Consistency for 3D Semantic Segmentationcited by 0
- 2023Explainable Semantic Medical Image Segmentation with Stylecited by 0
- 2023Medical Image Analysis using Deep Relational Learningcited by 0
- 2023Automated Ensemble-Based Segmentation of Adult Brain Tumors: A Novel Approach Using the BraTS AFRICA Challenge Datacited by 0
- 2023Tumor-Centered Patching for Enhanced Medical Image Segmentationcited by 0
- 2024Unsupervised Federated Domain Adaptation for Segmentation of MRI Imagescited by 0
50 most cited of 56 All 56 (JSON)
- 2026GPAFormer: Graph-guided Patch Aggregation Transformer for Efficient 3D Medical Image Segmentation8 Apr 2026
- 2025Efficient 3D Brain Tumor Segmentation with Axial-Coronal-Sagittal Embedding31 May 2025
- 2024QCResUNet: Joint Subject-level and Voxel-level Segmentation Quality Prediction10 Dec 2024
- 2024Automatic Prediction of Stroke Treatment Outcomes: Latest Advances and Perspectives6 Dec 2024
- 2024Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directions3 Dec 2024
- 2024Unveiling Incomplete Modality Brain Tumor Segmentation: Leveraging Masked Predicted Auto-Encoder and Divergence Learning12 Jun 2024
- 2024A review of deep learning-based information fusion techniques for multimodal medical image classification23 Apr 2024
- 2024LiteNeXt: A Novel Lightweight ConvMixer-based Model with Self-embedding Representation Parallel for Medical Image Segmentation4 Apr 2024
- 2024AgileFormer: Spatially Agile Transformer UNet for Medical Image Segmentation29 Mar 2024
- 2024Densely Decoded Networks with Adaptive Deep Supervision for Medical Image Segmentation5 Feb 2024
- 2024Unsupervised Federated Domain Adaptation for Segmentation of MRI Images2 Jan 2024
- 2023Tumor-Centered Patching for Enhanced Medical Image Segmentation23 Aug 2023
38 more
- 2023Automated Ensemble-Based Segmentation of Adult Brain Tumors: A Novel Approach Using the BraTS AFRICA Challenge Data14 Aug 2023
- 20233D Brainformer: 3D Fusion Transformer for Brain Tumor Segmentation28 Apr 2023
- 2023Medical Image Analysis using Deep Relational Learning28 Mar 2023
- 2023Mirror U-Net: Marrying Multimodal Fission with Multi-task Learning for Semantic Segmentation in Medical Imaging13 Mar 2023
- 2023Explainable Semantic Medical Image Segmentation with Style10 Mar 2023
- 2023Spatial Layout Consistency for 3D Semantic Segmentation2 Mar 2023
- 2023A Novel Collaborative Self-Supervised Learning Method for Radiomic Data20 Feb 2023
- 2023Exploiting Partial Common Information Microstructure for Multi-Modal Brain Tumor Segmentation6 Feb 2023
- 2023Acute ischemic stroke lesion segmentation in non-contrast CT images using 3D convolutional neural networks17 Jan 2023
- 2022On Calibrating Semantic Segmentation Models: Analyses and An Algorithm22 Dec 2022
- 2022Automated anomaly-aware 3D segmentation of bones and cartilages in knee MR images from the Osteoarthritis Initiative30 Nov 2022
- 2022Medical Image Segmentation Review: The success of U-Net27 Nov 2022
- 2022Multimodal Information Fusion for Glaucoma and DR Classification2 Sep 2022
- 2022Inflating 2D Convolution Weights for Efficient Generation of 3D Medical Images8 Aug 2022
- 2022Application of belief functions to medical image segmentation: A review3 May 2022
- 2022A Novel Mask R-CNN Model to Segment Heterogeneous Brain Tumors through Image Subtraction4 Apr 2022
- 2022Point-Unet: A Context-aware Point-based Neural Network for Volumetric Segmentation16 Mar 2022
- 2022Recursive 3D Segmentation of Shoulder Joint with Coarse-scanned MR Image13 Mar 2022
- 2022Joint brain tumor segmentation from multi MR sequences through a deep convolutional neural network7 Mar 2022
- 2022Label fusion and training methods for reliable representation of inter-rater uncertainty15 Feb 2022
- 2022Cross-Modality Deep Feature Learning for Brain Tumor Segmentation7 Jan 2022
- 2021Leveraging Human Selective Attention for Medical Image Analysis with Limited Training Data2 Dec 2021
- 2021Feature-enhanced Generation and Multi-modality Fusion based Deep Neural Network for Brain Tumor Segmentation with Missing MR Modalities8 Nov 2021
- 2021A Tri-attention Fusion Guided Multi-modal Segmentation Network2 Nov 2021
- 2021Distributing Deep Learning Hyperparameter Tuning for 3D Medical Image Segmentation29 Oct 2021
- 2021Deep Learning-based Segmentation of Cerebral Aneurysms in 3D TOF-MRA using Coarse-to-Fine Framework26 Oct 2021
- 2021An Automatic Detection Method Of Cerebral Aneurysms In Time-Of-Flight Magnetic Resonance Angiography Images Based On Attention 3D U-Net26 Oct 2021
- 2021Predicting survival of glioblastoma from automatic whole-brain and tumor segmentation of MR images25 Sep 2021
- 2021CAN3D: Fast 3D Medical Image Segmentation via Compact Context Aggregation12 Sep 2021
- 2021Generative Models Improve Radiomics Performance in Different Tasks and Different Datasets: An Experimental Study6 Sep 2021
- 2021Cherry-Picking Gradients: Learning Low-Rank Embeddings of Visual Data via Differentiable Cross-Approximation29 May 2021
- 2021Brain tumour segmentation using a triplanar ensemble of U-Nets24 May 2021
- 2021Latent Correlation Representation Learning for Brain Tumor Segmentation with Missing MRI Modalities13 Apr 2021
- 2021Artificial Intelligence in Tumor Subregion Analysis Based on Medical Imaging: A Review25 Mar 2021
- 2021Glioblastoma Multiforme Prognosis: MRI Missing Modality Generation, Segmentation and Radiogenomic Survival Prediction17 Mar 2021
- 2021TransMed: Transformers Advance Multi-modal Medical Image Classification10 Mar 2021
- 2021Deep and Statistical Learning in Biomedical Imaging: State of the Art in 3D MRI Brain Tumor Segmentation9 Mar 2021
- 2021Morphological Operation Residual Blocks: Enhancing 3D Morphological Feature Representation in Convolutional Neural Networks for Semantic Segmentation of Medical Images6 Mar 2021
50 newest of 56 All 56 (JSON)
- 2022Medical Image Segmentation Review: The success of U-Netcited by 190
- 2021TransMed: Transformers Advance Multi-modal Medical Image Classificationcited by 85
- 2021A Deep-Learning Approach For Direct Whole-Heart Mesh Reconstructioncited by 47
- 2021Latent Correlation Representation Learning for Brain Tumor Segmentation with Missing MRI Modalitiescited by 42
- 2022On Calibrating Semantic Segmentation Models: Analyses and An Algorithmcited by 25
- 2024A review of deep learning-based information fusion techniques for multimodal medical image classificationcited by 25
- 2022Cross-Modality Deep Feature Learning for Brain Tumor Segmentationcited by 22
- 2024Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directionscited by 17
- 2023Mirror U-Net: Marrying Multimodal Fission with Multi-task Learning for Semantic Segmentation in Medical Imagingcited by 14
- 2021Feature-enhanced Generation and Multi-modality Fusion based Deep Neural Network for Brain Tumor Segmentation with Missing MR Modalitiescited by 13
- 2022Label fusion and training methods for reliable representation of inter-rater uncertaintycited by 13
- 2022Point-Unet: A Context-aware Point-based Neural Network for Volumetric Segmentationcited by 11
12 most cited of 56 All 56 (JSON)
- 2026GPAFormer: Graph-guided Patch Aggregation Transformer for Efficient 3D Medical Image Segmentation8 Apr 2026
- 2025Efficient 3D Brain Tumor Segmentation with Axial-Coronal-Sagittal Embedding31 May 2025
- 2024QCResUNet: Joint Subject-level and Voxel-level Segmentation Quality Prediction10 Dec 2024
- 2024Automatic Prediction of Stroke Treatment Outcomes: Latest Advances and Perspectives6 Dec 2024
- 2024Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directions3 Dec 2024
- 2024Unveiling Incomplete Modality Brain Tumor Segmentation: Leveraging Masked Predicted Auto-Encoder and Divergence Learning12 Jun 2024
- 2024A review of deep learning-based information fusion techniques for multimodal medical image classification23 Apr 2024
- 2024LiteNeXt: A Novel Lightweight ConvMixer-based Model with Self-embedding Representation Parallel for Medical Image Segmentation4 Apr 2024
- 2024AgileFormer: Spatially Agile Transformer UNet for Medical Image Segmentation29 Mar 2024
- 2024Densely Decoded Networks with Adaptive Deep Supervision for Medical Image Segmentation5 Feb 2024
- 2024Unsupervised Federated Domain Adaptation for Segmentation of MRI Images2 Jan 2024
- 2023Tumor-Centered Patching for Enhanced Medical Image Segmentation23 Aug 2023
12 newest of 56 All 56 (JSON)