Knowledge-Guided Brain Tumor Segmentation via Synchronized Visual-Semantic-Topological Prior Fusion
Not on the map. Why?
Abstract (arXiv)
Background: Brain tumor segmentation requires precise delineation of hierarchical structures from multi-sequence MRI. However, existing deep learning methods primarily rely on visual features, showing insufficient discriminative power in ambiguous boundary regions. Moreover, they lack explicit integration of medical domain knowledge such as anatomical semantics and geometric topology. Methods: We propose a knowledge-guided framework, Synchronized Tri-modal Prior Fusion (STPF), that explicitly integrates three heterogeneous knowledge priors: pathology-driven differential features (T1ce-T1, T2-FLAIR, T1/T2) encoding contrast patterns; unsupervised semantic descriptions transformed into voxel-level guidance via spatialization operators; and geometric constraints extracted through persistent homology analysis. A dual-level fusion architecture dynamically allocates prior weights at the voxel level based on confidence and at the sample level through hypernetwork-generated conditional vectors. Furthermore, nested output heads structurally ensure the hierarchical constraint ET subset TC subset WT. Results: STPF achieves a mean Dice coefficient of 0.868 on the BraTS 2020 dataset, surpassing the best baseline by 2.6 percentage points (3.09% relative improvement). Notably, five-fold cross-validation yields coefficients of variation between 0.23% and 0.33%, demonstrating stable performance. Additionally, ablation experiments show that removing topological and semantic priors leads to performance degradation of 2.8% and 3.5%, respectively. Conclusions: By explicitly integrating medical knowledge priors - anatomical semantics and geometric constraints - STPF improves segmentation accuracy in ambiguous boundary regions while demonstrating generalization capability and clinical deployment potential.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 62 references that are in the map. First posted on arXiv 11 Jul 2025.
Builds on
29 of 62 references.
References · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2017Graph Attention Networkscited by 8,854
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 438
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
- 20183D MRI brain tumor segmentation using autoencoder regularizationcited by 324
- 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
17 more
- 2021TransBTS: Multimodal Brain Tumor Segmentation Using Transformercited by 265
- 2022Metrics reloaded: Recommendations for image analysis validationcited by 190
- 2019A Topological Loss Function for Deep-Learning based Image Segmentation using Persistent Homologycited by 134
- 2016HeMIS: Hetero-Modal Image Segmentationcited by 102
- 2022Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion Modelscited by 96
- 2022NestedFormer: Nested Modality-Aware Transformer for Brain Tumor Segmentationcited by 33
- 2022CKD-TransBTS: Clinical Knowledge-Driven Hybrid Transformer with Modality-Correlated Cross-Attention for Brain Tumor Segmentationcited by 24
- 2021ASC-Net : Adversarial-based Selective Network for Unsupervised Anomaly Segmentationcited by 15
- 2024Analysis of the BraTS 2023 Intracranial Meningioma Segmentation Challengecited by 14
- 2023ConTEXTual Net: A Multimodal Vision-Language Model for Segmentation of Pneumothoraxcited by 10
- 2024Leveraging the Mahalanobis Distance to enhance Unsupervised Brain MRI Anomaly Detectioncited by 10
- 2021Deep Class-Specific Affinity-Guided Convolutional Network for Multimodal Unpaired Image Segmentationcited by 5
- 2024SEG-SAM: Semantic-Guided SAM for Unified Medical Image Segmentationcited by 5
- 2025From Gaze to Insight: Bridging Human Visual Attention and Vision Language Model Explanation for Weakly-Supervised Medical Image Segmentationcited by 5
- 2024FDiff-Fusion:Denoising diffusion fusion network based on fuzzy learning for 3D medical image segmentationcited by 3
- 2024Exploring Adult Glioma through MRI: A Review of Publicly Available Datasets to Guide Efficient Image Analysiscited by 3
- 2024Understanding implementation pitfalls of distance-based metrics for image segmentationcited by 3
Built on by
Not cited yet.