When Fusion Fails: Corruption-Aware Rebalanced Fusion for Multi-Modal Medical Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Multi-modal medical image segmentation leverages complementary diagnostic information, yet fusion can underperform single-modality baselines when spatially aligned inputs differ in quality. Here, "corruption" primarily denotes resolution-induced degradation rather than misalignment or complete modality absence, while synthetic noise is evaluated only as an auxiliary setting. We identify a critical optimization-inference inconsistency: degraded modalities can receive weak training updates yet substantially affect predictions, indicating active interference with fusion. We attribute this failure to resampling-induced feature corruption and optimization bias, where noisy features propagate through skip connections and encourage unreliable modality selection. We therefore propose CoReFuse-Med, a Corruption-aware Rebalanced Fusion framework that suppresses corruption during feature transmission and rebalances modality contributions during high-level fusion. Experiments on EPVS, BraTS, and WMH, including multiple Z-axis slice-retention ratios and an auxiliary noise test, demonstrate improved accuracy and robustness under modality-quality discrepancies. Our code is available at https://github.com/lrever/CoReFuse.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 26 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
12 of 26 references.
References · 12
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2019What Makes Training Multi-Modal Classification Networks Hard?cited by 340
- 2015Brain Tumor Segmentation with Deep Neural Networkscited by 137
- 2019Standardized Assessment of Automatic Segmentation of White Matter Hyperintensities and Results of the WMH Segmentation Challengecited by 115
- 2022PMR: Prototypical Modal Rebalance for Multimodal Learningcited by 114
- 2020A review: Deep learning for medical image segmentation using multi-modality fusioncited by 84
- 2021Modality-aware Mutual Learning for Multi-modal Medical Image Segmentationcited by 47
- 2023Enhancing multimodal cooperation via sample-level modality valuationcited by 43
- 2021QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Resultscited by 28
- 2022Multi-Modality Cardiac Image Computing: A Surveycited by 19
- 2025HNOSeg-XS: Extremely Small Hartley Neural Operator for Efficient and Resolution-Robust 3D Image Segmentationcited by 2
Built on by
Not cited yet.