Text-Guided Medical Image Segmentation via Residual Aggregation and Dense Alignment Representations
Not on the map. Why?
Abstract (arXiv)
Specifying segmentation targets with natural language provides flexible semantic conditioning for medical image segmentation. However, existing methods still struggle to reliably ground high-level textual semantics into accurate pixel-level spatial prompts, especially under low-contrast lesions, ambiguous boundaries, and visually similar anatomical contexts. In this paper, we propose RADAR (Residual Aggregation and Dense Alignment Representations), a parameter-efficient framework for text-guided medical image segmentation. RADAR explicitly decouples and synergizes the medical semantic anchoring capability of BiomedCLIP with the prompt-driven mask decoding ability of MedSAM2, while enabling low-cost task adaptation via LoRA. Specifically, Guided Residual Depth Aggregation adaptively aggregates cross-layer features under semantic guidance to alleviate delayed textual injection and deep semantic dilution. Structured Dense Representation Alignment leverages a frozen BiomedCLIP to construct crop-level target, boundary, and context anchors, improving the local discriminability of dense features and the reliability of automatic prompts. Multi-modal Prompt Generation further converts cross-modal semantic responses into composite text, point, and mask prompts for MedSAM2 decoding. Experiments on three public medical image segmentation datasets show that RADAR achieves competitive performance with only 0.74M trainable parameters, demonstrating its effectiveness in parameter-efficient adaptation, semantic grounding, and dense representation enhancement. The source code is available at https://github.com/JGuiidev/RADAR.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 41 references that are in the map. First posted on arXiv 10 Oct 2026.
Builds on
29 of 41 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Segment Anythingcited by 8,234
- 2016Layer Normalizationcited by 5,669
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
17 more
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 589
- 2021Extract Free Dense Labels from CLIPcited by 583
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
- 2023CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Predictioncited by 118
- 2022LViT: Language meets Vision Transformer in Medical Image Segmentationcited by 111
- 2020MosMedData: Chest CT Scans With COVID-19 Related Findings Datasetcited by 104
- 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 65
- 2022OSegNet: Operational Segmentation Network for COVID-19 Detection using Chest X-ray Imagescited by 48
- 2024MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentationcited by 39
- 2023Ariadne's Thread:Using Text Prompts to Improve Segmentation of Infected Areas from Chest X-ray imagescited by 34
- 2024Cross-Modal Conditioned Reconstruction for Language-guided Medical Image Segmentationcited by 28
- 2024Effective SAM Combination for Open-Vocabulary Semantic Segmentationcited by 17
- 2024Deep Instruction Tuning for Segment Anything Modelcited by 5
- 2026Uncertainty-Aware Vision-Language Segmentation for Medical Imagingcited by 5
- 2026MedCLIPSeg: Probabilistic Vision-Language Adaptation for Data-Efficient and Generalizable Medical Image Segmentationcited by 4
Built on by
Not cited yet.