Text-guided multi-stage cross-perception network for medical image segmentation
Not on the map. Why?
Abstract (arXiv)
Medical image segmentation plays a crucial role in clinical medicine, serving as a key tool for auxiliary diagnosis, treatment planning, and disease monitoring. However, traditional segmentation methods such as U-Net are often limited by weak semantic expression of target regions, which stems from insufficient generalization and a lack of interactivity. Incorporating text prompts offers a promising avenue to more accurately pinpoint lesion locations, yet existing text-guided methods are still hindered by insufficient cross-modal interaction and inadequate cross-modal feature representation. To address these challenges, we propose the Text-guided Multi-stage Cross-perception network (TMC). TMC incorporates a Multi-stage Cross-attention Module (MCM) to enhance the model's understanding of fine-grained semantic details and a Multi-stage Alignment Loss (MA Loss) to improve the consistency of cross-modal semantics across different feature levels. Experimental results on three public datasets (QaTa-COV19, MosMedData, and Duke-Breast-Cancer-MRI) demonstrate the superior performance of TMC, achieving Dice scores of 84.65%, 78.39%, and 88.09%, respectively, and consistently outperforming both U-Net-based networks and existing text-guided methods.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 33 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
23 of 33 references.
References · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 641
- 2021UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformercited by 197
11 more
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 179
- 2022Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learningcited by 159
- 2022LViT: Language meets Vision Transformer in Medical Image Segmentationcited by 111
- 2020MosMedData: Chest CT Scans With COVID-19 Related Findings Datasetcited by 104
- 2021Joint Learning of Localized Representations from Medical Images and Reportscited by 81
- 2024EMCAD: Efficient Multi-scale Convolutional Attention Decoding for Medical Image Segmentationcited by 64
- 2022TGANet: Text-guided attention for improved polyp segmentationcited by 59
- 2022OSegNet: Operational Segmentation Network for COVID-19 Detection using Chest X-ray Imagescited by 48
- 2022MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Modelcited by 41
- 2024MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentationcited by 39
- 2024SimTxtSeg: Weakly-Supervised Medical Image Segmentation with Simple Text Cuescited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.