mlsanityData to 14 Oct 2026

Unified Multimodal Coherent Field: Synchronous Semantic-Spatial-Vision Fusion for Brain Tumor Segmentation

arXiv 2509.17520 ↗First posted 22 Sep 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Brain tumor segmentation requires accurate identification of hierarchical regions including whole tumor (WT), tumor core (TC), and enhancing tumor (ET) from multi-sequence magnetic resonance imaging (MRI) images. Due to tumor tissue heterogeneity, ambiguous boundaries, and contrast variations across MRI sequences, methods relying solely on visual information or post-hoc loss constraints show unstable performance in boundary delineation and hierarchy preservation. To address this challenge, we propose the Unified Multimodal Coherent Field (UMCF) method. This method achieves synchronous interactive fusion of visual, semantic, and spatial information within a unified 3D latent space, adaptively adjusting modal contributions through parameter-free uncertainty gating, with medical prior knowledge directly participating in attention computation, avoiding the traditional "process-then-concatenate" separated architecture. On Brain Tumor Segmentation (BraTS) 2020 and 2021 datasets, UMCF+nnU-Net achieves average Dice coefficients of 0.8579 and 0.8977 respectively, with an average 4.18% improvement across mainstream architectures. By deeply integrating clinical knowledge with imaging features, UMCF provides a new technical pathway for multimodal information fusion in precision medicine.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

13 of 27 references.

References · 13

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  4. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  5. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
  6. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
  7. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  8. 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
  9. 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
  10. 2022On the Optimal Combination of Cross-Entropy and Soft Dice Losses for Lesion Segmentation with Out-of-Distribution Robustnesscited by 11
  11. 2022Reciprocal Adversarial Learning for Brain Tumor Segmentation: A Solution to BraTS Challenge 2021 Segmentation Taskcited by 9
  12. 2024LATUP-Net: A Lightweight 3D Attention U-Net with Parallel Convolutions for Brain Tumor Segmentationcited by 7
1 more
  1. 2025Multimodal Fusion at Three Tiers: Physics-Driven Data Generation and Vision-Language Guidance for Brain Tumor Segmentationcited by 1

Built on by

Not cited yet.