Deep evidential fusion with uncertainty quantification and contextual discounting for multimodal medical image segmentation
Not on the map. Why?
Abstract (arXiv)
Single-modality medical images generally do not contain enough information to reach an accurate and reliable diagnosis. For this reason, physicians generally diagnose diseases based on multimodal medical images such as, e.g., PET/CT. The effective fusion of multimodal information is essential to reach a reliable decision and explain how the decision is made as well. In this paper, we propose a fusion framework for multimodal medical image segmentation based on deep learning and the Dempster-Shafer theory of evidence. In this framework, the reliability of each single modality image when segmenting different objects is taken into account by a contextual discounting operation. The discounted pieces of evidence from each modality are then combined by Dempster's rule to reach a final decision. Experimental results with a PET-CT dataset with lymphomas and a multi-MRI dataset with brain tumors show that our method outperforms the state-of-the-art methods in accuracy and reliability.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 27 of its 109 references that are in the map. First posted on arXiv 12 Sep 2023.
Builds on
27 of 109 references.
References · 27
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
- 2020A Survey on Visual Transformercited by 653
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
- 2022Multimodal Learning with Transformers: A Surveycited by 399
- 20183D MRI brain tumor segmentation using autoencoder regularizationcited by 324
- 2018nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentationcited by 291
- 2021nnFormer: Interleaved Transformer for Volumetric Segmentationcited by 179
15 more
- 2020A review: Deep learning for medical image segmentation using multi-modality fusioncited by 84
- 2016Understanding Probabilistic Sparse Gaussian Process Approximationscited by 68
- 2021A Robust Volumetric Transformer for Accurate 3D Tumor Segmentationcited by 41
- 2021Extending nn-UNet for brain tumor segmentationcited by 36
- 2022TBraTS: Trusted Brain Tumor Segmentationcited by 30
- 2020Post Training Uncertainty Calibration of Deep Networks For Medical Image Segmentationcited by 19
- 2021An evidential classifier based on Dempster-Shafer theory and deep learningcited by 18
- 2018Decision-Making with Belief Functions: a Reviewcited by 13
- 2022Lymphoma segmentation from 3D PET-CT images using a deep evidential networkcited by 12
- 2022Evidence fusion with contextual discounting for multi-modality medical image segmentationcited by 12
- 2021Belief function-based semi-supervised learning for brain tumor segmentationcited by 11
- 2021Evidential fully convolutional network for semantic segmentationcited by 11
- 2021A Tri-attention Fusion Guided Multi-modal Segmentation Networkcited by 10
- 2020NN-EVCLUS: Neural Network-based Evidential Clusteringcited by 5
- 2022Application of belief functions to medical image segmentation: A reviewcited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 1.
2 papers.