mlsanityData to 7 Oct 2026

Hierarchical Text-Guided Brain Tumor Segmentation via Sub-Region-Aware Prompts

arXiv 2603.21083 ↗First posted 22 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Brain tumor segmentation remains challenging because the three standard sub-regions, i.e., whole tumor (WT), tumor core (TC), and enhancing tumor (ET), often exhibit ambiguous visual boundaries. Integrating radiological description texts with imaging has shown promise. However, most multimodal approaches typically compress a report into a single global text embedding shared across all sub-regions, overlooking their distinct clinical characteristics. We propose TextCSP (text-modulated soft cascade architecture), a hierarchical text-guided framework that builds on the TextBraTS baseline with three novel components: (1) a text-modulated soft cascade decoder that predicts WT->TC->ET in a coarse-to-fine manner consistent with their anatomical containment hierarchy. (2) sub-region-aware prompt tuning, which uses learnable soft prompts with a LoRA-adapted BioBERT encoder to generate specialized text representations tailored for each sub-region; (3) text-semantic channel modulators that convert the aforementioned representations into channel-wise refinement signals, enabling the decoder to emphasize features aligned with clinically described patterns. Experiments on the TextBraTS dataset demonstrate consistent improvements across all sub-regions against state-of-the-art methods by 1.7% and 6% on the main metrics Dice and HD95.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 22 Mar 2026.

Builds on

12 of 20 references.

References · 12

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2017Squeeze-and-Excitation Networkscited by 4,763
  4. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  5. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
  6. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  7. 2022MONAI: An open-source framework for deep learning in healthcarecited by 438
  8. 2022NestedFormer: Nested Modality-Aware Transformer for Brain Tumor Segmentationcited by 33
  9. 2024VividMed: Vision Language Model with Versatile Visual Grounding for Medicinecited by 28
  10. 2025MedSAM3: Delving into Segment Anything with Medical Conceptscited by 25
  11. 2025VoxTell: Free-Text Promptable Universal 3D Medical Image Segmentationcited by 19
  12. 2025TextBraTS: Text-Guided Volumetric Brain Tumor Segmentation with Innovative Dataset Development and Fusion Module Explorationcited by 4

Built on by

Not cited yet.