Brain Tumor Segmentation on MRI with Missing Modalities
Not on the map. Why?
Abstract (arXiv)
Brain Tumor Segmentation from magnetic resonance imaging (MRI) is a critical technique for early diagnosis. However, rather than having complete four modalities as in BraTS dataset, it is common to have missing modalities in clinical scenarios. We design a brain tumor segmentation algorithm that is robust to the absence of any modality. Our network includes a channel-independent encoding path and a feature-fusion decoding path. We use self-supervised training through channel dropout and also propose a novel domain adaptation method on feature maps to recover the information from the missing channel. Our results demonstrate that the quality of the segmentation depends on which modality is missing. Furthermore, we also discuss and visualize the contribution of each modality to the segmentation results. Their contributions are along well with the expert screening routine.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 9; 2024: 11; 2025: 7; 2026: 5.
42 papers.
Sort:
By area:
- 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 159
- 2022mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentationcited by 94
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 89
- 2023Adaptive Latent Diffusion Model for 3D Medical Image to Image Translation: Multi-modal Magnetic Resonance Imaging Studycited by 64
- 2023M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalitiescited by 56
- 2024DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistencycited by 51
- 2023Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modalitycited by 44
- 2021Latent Correlation Representation Learning for Brain Tumor Segmentation with Missing MRI Modalitiescited by 42
- 2025A Closer Look at Multimodal Representation Collapsecited by 25
- 2023Missing Modality Robustness in Semi-Supervised Multi-Modal Semantic Segmentationcited by 24
- 2021Transfer Learning in Magnetic Resonance Brain Imaging: a Systematic Reviewcited by 19
- 2022Multi-Modality Cardiac Image Computing: A Surveycited by 19
30 more
- 2022Medical Image Segmentation on MRI Images with Missing Modalities: A Reviewcited by 18
- 2023Enhancing Modality-Agnostic Representations via Meta-Learning for Brain Tumor Segmentationcited by 14
- 2021Feature-enhanced Generation and Multi-modality Fusion based Deep Neural Network for Brain Tumor Segmentation with Missing MR Modalitiescited by 13
- 2024Gradient-Guided Modality Decoupling for Missing-Modality Robustnesscited by 11
- 2022Rethinking Generalization: The Impact of Annotation Style on Medical Image Segmentationcited by 10
- 2023CoRe-Sleep: A Multimodal Fusion Framework for Time Series Robust to Imperfect Modalitiescited by 10
- 2024Multimodal Data Integration for Precision Oncology: Challenges and Future Directionscited by 10
- 2023Dynamic Enhancement Network for Partial Multi-modality Person Re-identificationcited by 9
- 2024Federated Modality-specific Encoders and Multimodal Anchors for Personalized Brain Tumor Segmentationcited by 8
- 2024Meta-Learned Modality-Weighted Knowledge Distillation for Robust Multi-Modal Learning with Missing Datacited by 5
- 2024Feasibility of Federated Learning from Client Databases with Different Brain Diseases and MRI Modalitiescited by 5
- 2025Memory-Augmented Incomplete Multimodal Survival Prediction via Cross-Slide and Gene-Attentive Hypergraph Learningcited by 4
- 2025Multimodal Masked Autoencoder Pre-training for 3D MRI-Based Brain Tumor Analysis with Missing Modalitiescited by 3
- 2026Federated Modality-specific Encoders and Partially Personalized Fusion Decoder for Multimodal Brain Tumor Segmentationcited by 3
- 2021Cohort Bias Adaptation in Aggregated Datasets for Lesion Segmentationcited by 2
- 2022DS3-Net: Difficulty-perceived Common-to-T1ce Semi-Supervised Multimodal MRI Synthesis Networkcited by 1
- 2024A Multimodal Feature Distillation with Mamba-Transformer Network for Brain Tumor Segmentation with Incomplete Modalitiescited by 1
- 2025DiA-gnostic VLVAE: Disentangled Alignment-Constrained Vision Language Variational AutoEncoder for Robust Radiology Reporting with Missing Modalitiescited by 1
- 2026SRUG: A Fusion-Driven Generator Network for Medical Image Translationcited by 1
- 2021Inter-Domain Alignment for Predicting High-Resolution Brain Networks Using Teacher-Student Learningcited by 0
- 2023ReFuSeg: Regularized Multi-Modal Fusion for Precise Brain Tumour Segmentationcited by 0
- 2024MDA: An Interpretable and Scalable Multi-Modal Fusion under Missing Modalities and Intrinsic Noise Conditionscited by 0
- 2024Full Information Linked ICA: addressing missing data problem in multimodal fusioncited by 0
- 2024QCResUNet: Joint Subject-level and Voxel-level Segmentation Quality Predictioncited by 0
- 2025Structure-Accurate Medical Image Translation via Dynamic Frequency Balance and Knowledge Guidancecited by 0
- 2025F3-Net: Foundation Model for Full Abnormality Segmentation of Medical Images with Flexible Input Modality Requirementcited by 0
- 2025TARDis: Time Attenuated Representation Disentanglement for Incomplete Multi-Modal Tumor Segmentation and Classificationcited by 0
- 2026Brain MR Image Synthesis with 3D Multi-Contrast Self-Attention GANcited by 0
- 2026Virtual Nodes Guided Dynamic Graph Neural Network for Brain Tumor Segmentation with Missing Modalitiescited by 0
- 2026Unified Multimodal Model for Brain MRI Imputation and Understandingcited by 0
- 2026Unified Multimodal Model for Brain MRI Imputation and Understanding15 Jun 2026
- 2026Virtual Nodes Guided Dynamic Graph Neural Network for Brain Tumor Segmentation with Missing Modalities16 May 2026
- 2026Brain MR Image Synthesis with 3D Multi-Contrast Self-Attention GAN31 Mar 2026
- 2026Federated Modality-specific Encoders and Partially Personalized Fusion Decoder for Multimodal Brain Tumor Segmentation5 Mar 2026
- 2026SRUG: A Fusion-Driven Generator Network for Medical Image Translation8 Jan 2026
- 2025TARDis: Time Attenuated Representation Disentanglement for Incomplete Multi-Modal Tumor Segmentation and Classification4 Dec 2025
- 2025DiA-gnostic VLVAE: Disentangled Alignment-Constrained Vision Language Variational AutoEncoder for Robust Radiology Reporting with Missing Modalities8 Nov 2025
- 2025F3-Net: Foundation Model for Full Abnormality Segmentation of Medical Images with Flexible Input Modality Requirement11 Jul 2025
- 2025Memory-Augmented Incomplete Multimodal Survival Prediction via Cross-Slide and Gene-Attentive Hypergraph Learning24 Jun 2025
- 2025A Closer Look at Multimodal Representation Collapse28 May 2025
- 2025Multimodal Masked Autoencoder Pre-training for 3D MRI-Based Brain Tumor Analysis with Missing Modalities1 May 2025
- 2025Structure-Accurate Medical Image Translation via Dynamic Frequency Balance and Knowledge Guidance13 Apr 2025
30 more
- 2024QCResUNet: Joint Subject-level and Voxel-level Segmentation Quality Prediction10 Dec 2024
- 2024Deep Multimodal Learning with Missing Modality: A Survey12 Sep 2024
- 2024Multimodal Data Integration for Precision Oncology: Challenges and Future Directions28 Jun 2024
- 2024Full Information Linked ICA: addressing missing data problem in multimodal fusion27 Jun 2024
- 2024Feasibility of Federated Learning from Client Databases with Different Brain Diseases and MRI Modalities17 Jun 2024
- 2024MDA: An Interpretable and Scalable Multi-Modal Fusion under Missing Modalities and Intrinsic Noise Conditions15 Jun 2024
- 2024Meta-Learned Modality-Weighted Knowledge Distillation for Robust Multi-Modal Learning with Missing Data12 May 2024
- 2024A Multimodal Feature Distillation with Mamba-Transformer Network for Brain Tumor Segmentation with Incomplete Modalities22 Apr 2024
- 2024Federated Modality-specific Encoders and Multimodal Anchors for Personalized Brain Tumor Segmentation18 Mar 2024
- 2024DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistency10 Mar 2024
- 2024Gradient-Guided Modality Decoupling for Missing-Modality Robustness26 Feb 2024
- 2023Adaptive Latent Diffusion Model for 3D Medical Image to Image Translation: Multi-modal Magnetic Resonance Imaging Study1 Nov 2023
- 2023Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality2 Oct 2023
- 2023ReFuSeg: Regularized Multi-Modal Fusion for Precise Brain Tumour Segmentation26 Aug 2023
- 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modelling26 Jul 2023
- 2023Dynamic Enhancement Network for Partial Multi-modality Person Re-identification25 May 2023
- 2023Missing Modality Robustness in Semi-Supervised Multi-Modal Semantic Segmentation21 Apr 2023
- 2023CoRe-Sleep: A Multimodal Fusion Framework for Time Series Robust to Imperfect Modalities27 Mar 2023
- 2023M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalities9 Mar 2023
- 2023Enhancing Modality-Agnostic Representations via Meta-Learning for Brain Tumor Segmentation8 Feb 2023
- 2022Rethinking Generalization: The Impact of Annotation Style on Medical Image Segmentation31 Oct 2022
- 2022Multi-Modality Cardiac Image Computing: A Survey26 Aug 2022
- 2022mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation6 Jun 2022
- 2022DS3-Net: Difficulty-perceived Common-to-T1ce Semi-Supervised Multimodal MRI Synthesis Network14 Mar 2022
- 2022Medical Image Segmentation on MRI Images with Missing Modalities: A Review11 Mar 2022
- 2021Feature-enhanced Generation and Multi-modality Fusion based Deep Neural Network for Brain Tumor Segmentation with Missing MR Modalities8 Nov 2021
- 2021Inter-Domain Alignment for Predicting High-Resolution Brain Networks Using Teacher-Student Learning6 Oct 2021
- 2021Cohort Bias Adaptation in Aggregated Datasets for Lesion Segmentation2 Aug 2021
- 2021Latent Correlation Representation Learning for Brain Tumor Segmentation with Missing MRI Modalities13 Apr 2021
- 2021Transfer Learning in Magnetic Resonance Brain Imaging: a Systematic Review2 Feb 2021
- 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 159
- 2022mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentationcited by 94
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 89
- 2023M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalitiescited by 56
- 2024DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistencycited by 51
- 2023Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modalitycited by 44
- 2021Latent Correlation Representation Learning for Brain Tumor Segmentation with Missing MRI Modalitiescited by 42
- 2025A Closer Look at Multimodal Representation Collapsecited by 25
- 2023Missing Modality Robustness in Semi-Supervised Multi-Modal Semantic Segmentationcited by 24
- 2021Transfer Learning in Magnetic Resonance Brain Imaging: a Systematic Reviewcited by 19
- 2022Multi-Modality Cardiac Image Computing: A Surveycited by 19
- 2022Medical Image Segmentation on MRI Images with Missing Modalities: A Reviewcited by 18
12 most cited of 38 All 38 (JSON)
- 2026Virtual Nodes Guided Dynamic Graph Neural Network for Brain Tumor Segmentation with Missing Modalities16 May 2026
- 2026Brain MR Image Synthesis with 3D Multi-Contrast Self-Attention GAN31 Mar 2026
- 2026Federated Modality-specific Encoders and Partially Personalized Fusion Decoder for Multimodal Brain Tumor Segmentation5 Mar 2026
- 2026SRUG: A Fusion-Driven Generator Network for Medical Image Translation8 Jan 2026
- 2025TARDis: Time Attenuated Representation Disentanglement for Incomplete Multi-Modal Tumor Segmentation and Classification4 Dec 2025
- 2025F3-Net: Foundation Model for Full Abnormality Segmentation of Medical Images with Flexible Input Modality Requirement11 Jul 2025
- 2025Memory-Augmented Incomplete Multimodal Survival Prediction via Cross-Slide and Gene-Attentive Hypergraph Learning24 Jun 2025
- 2025A Closer Look at Multimodal Representation Collapse28 May 2025
- 2025Multimodal Masked Autoencoder Pre-training for 3D MRI-Based Brain Tumor Analysis with Missing Modalities1 May 2025
- 2025Structure-Accurate Medical Image Translation via Dynamic Frequency Balance and Knowledge Guidance13 Apr 2025
- 2024QCResUNet: Joint Subject-level and Voxel-level Segmentation Quality Prediction10 Dec 2024
- 2024Deep Multimodal Learning with Missing Modality: A Survey12 Sep 2024
12 newest of 38 All 38 (JSON)