mlsanityData to 7 Oct 2026

When Fusion Fails: Corruption-Aware Rebalanced Fusion for Multi-Modal Medical Image Segmentation

arXiv 2609.10261 ↗First posted 9 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-modal medical image segmentation leverages complementary diagnostic information, yet fusion can underperform single-modality baselines when spatially aligned inputs differ in quality. Here, "corruption" primarily denotes resolution-induced degradation rather than misalignment or complete modality absence, while synthetic noise is evaluated only as an auxiliary setting. We identify a critical optimization-inference inconsistency: degraded modalities can receive weak training updates yet substantially affect predictions, indicating active interference with fusion. We attribute this failure to resampling-induced feature corruption and optimization bias, where noisy features propagate through skip connections and encourage unreliable modality selection. We therefore propose CoReFuse-Med, a Corruption-aware Rebalanced Fusion framework that suppresses corruption during feature transmission and rebalances modality contributions during high-level fusion. Experiments on EPVS, BraTS, and WMH, including multiple Z-axis slice-retention ratios and an auxiliary noise test, demonstrate improved accuracy and robustness under modality-quality discrepancies. Our code is available at https://github.com/lrever/CoReFuse.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 26 references that are in the map. First posted on arXiv 9 Sep 2026.

Builds on

12 of 26 references.

References · 12

  1. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
  2. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  3. 2019What Makes Training Multi-Modal Classification Networks Hard?cited by 340
  4. 2015Brain Tumor Segmentation with Deep Neural Networkscited by 137
  5. 2019Standardized Assessment of Automatic Segmentation of White Matter Hyperintensities and Results of the WMH Segmentation Challengecited by 115
  6. 2022PMR: Prototypical Modal Rebalance for Multimodal Learningcited by 114
  7. 2020A review: Deep learning for medical image segmentation using multi-modality fusioncited by 84
  8. 2021Modality-aware Mutual Learning for Multi-modal Medical Image Segmentationcited by 47
  9. 2023Enhancing multimodal cooperation via sample-level modality valuationcited by 43
  10. 2021QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Resultscited by 28
  11. 2022Multi-Modality Cardiac Image Computing: A Surveycited by 19
  12. 2025HNOSeg-XS: Extremely Small Hartley Neural Operator for Efficient and Resolution-Robust 3D Image Segmentationcited by 2

Built on by

Not cited yet.