mlsanityData to 14 Oct 2026

Ariadne's Thread:Using Text Prompts to Improve Segmentation of Infected Areas from Chest X-ray images

arXiv 2307.03942 ↗First posted 8 Jul 2023eess.IV cs.CVcited by 34

Not on the map. Why?

Abstract (arXiv)

Segmentation of the infected areas of the lung is essential for quantifying the severity of lung disease like pulmonary infections. Existing medical image segmentation methods are almost uni-modal methods based on image. However, these image-only methods tend to produce inaccurate results unless trained with large amounts of annotated data. To overcome this challenge, we propose a language-driven segmentation method that uses text prompt to improve to the segmentation result. Experiments on the QaTa-COV19 dataset indicate that our method improves the Dice score by 6.09% at least compared to the uni-modal methods. Besides, our extended study reveals the flexibility of multi-modal methods in terms of the information granularity of text and demonstrates that multi-modal methods have a significant advantage over image-only methods in terms of the size of training data required.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 16 of its 22 references that are in the map. First posted on arXiv 8 Jul 2023.

Builds on

16 of 22 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2022A ConvNet for the 2020scited by 3,579
  4. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
  5. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
  6. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
  7. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
  8. 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
  9. 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 532
  10. 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
  11. 2021CRIS: CLIP-Driven Referring Image Segmentationcited by 353
  12. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
4 more
  1. 2020Inf-Net: Automatic COVID-19 Lung Infection Segmentation from CT Imagescited by 184
  2. 2022LViT: Language meets Vision Transformer in Medical Image Segmentationcited by 111
  3. 2022OSegNet: Operational Segmentation Network for COVID-19 Detection using Chest X-ray Imagescited by 48
  4. 2021Improving Pneumonia Localization via Cross-Attention on Medical Images and Reportscited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 7; 2025: 15; 2026: 12.

34 papers.

Sort:

By area:

  1. 2025MedGround-R1: Advancing Medical Image Grounding via Spatial-Semantic Rewarded Group Relative Policy Optimizationcited by 23
  2. 2024PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learningcited by 17
  3. 2024SGSeg: Enabling Text-free Inference in Language-guided Segmentation of Chest X-rays via Self-guidancecited by 11
  4. 2024A Survey of Medical Vision-and-Language Applications and Their Techniquescited by 11
  5. 2025MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representationscited by 11
  6. 2025Taming Vision-Language Models for Medical Image Analysis: A Comprehensive Reviewcited by 9
  7. 2024SimTxtSeg: Weakly-Supervised Medical Image Segmentation with Simple Text Cuescited by 6
  8. 2024MulModSeg: Enhancing Unpaired Multi-Modal Medical Image Segmentation with Modality-Conditioned Text Embedding and Alternating Trainingcited by 6
  9. 2024Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignmentscited by 6
  10. 2025STPNet: Scale-aware Text Prompt Network for Medical Image Segmentationcited by 6
  11. 2025Alleviating Textual Reliance in Medical Language-guided Segmentation via Prototype-driven Semantic Approximationcited by 6
  12. 2025Frequency-domain Multi-modal Fusion for Language-guided Medical Image Segmentationcited by 4
22 more
  1. 2024TexLiverNet: Leveraging Medical Knowledge and Spatial-Frequency Perception for Enhanced Liver Tumor Segmentationcited by 1
  2. 2025Minding Fuzzy Regions: A Data-driven Alternating Learning Paradigm for Stable Lesion Segmentationcited by 1
  3. 2025BiPVL-Seg: Bidirectional Progressive Vision-Language Fusion with Global-Local Alignment for Medical Image Segmentationcited by 1
  4. 2025Text Embedded Swin-UMamba for DeepLesion Segmentationcited by 1
  5. 2025A Text-Image Fusion Method with Data Augmentation Capabilities for Referring Medical Image Segmentationcited by 1
  6. 2026Localization-Infused Vision-Language Semantic Fusion for Text-Guided Medical Image Segmentationcited by 1
  7. 2025Prompt Mechanisms in Medical Imaging: A Comprehensive Surveycited by 0
  8. 2025Medical Referring Image Segmentation via Next-Token Mask Predictioncited by 0
  9. 2025TCSA-UDA: Text-Driven Cross-Semantic Alignment for Unsupervised Domain Adaptation in Medical Image Segmentationcited by 0
  10. 2025TGC-Net: A Structure-Aware and Semantically-Aligned Framework for Text-Guided Medical Image Segmentationcited by 0
  11. 2025Spatial-aware Symmetric Alignment for Text-guided Medical Image Segmentationcited by 0
  12. 2026TAMISeg: Text-Aligned Multi-scale Medical Image Segmentation with Semantic Encoder Distillationcited by 0
  13. 2026Semi-MedRef: Semi-Supervised Medical Referring Image Segmentation with Cross-Modal Alignmentcited by 0
  14. 2026Text as Illumination: Spatial Contrastive Retinex Learning for Language-guided Medical Image Segmentationcited by 0
  15. 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigmscited by 0
  16. 2026Decoupling Language Guidance from Backbones for Text-Guided Medical Segmentationcited by 0
  17. 2026DistMedVL: Distributional Vision-Language Alignment for Uncertainty-Aware Medical Image Segmentationcited by 0
  18. 2026MedPlex: Deep Vision-Language Co-Adaptation for Clinically Grounded Medical Segmentationcited by 0
  19. 2026CoMLP: Cooperatively-Gated MLPs for Fine-Grained Cross-Modal Information Fusion in Medical Image Segmentationcited by 0
  20. 2026CGSM: Concept-Guided Segmentation Model for Precise Pulmonary Lesion Delineationcited by 0
  21. 2026Multimodal Routing and Region Refinement for Language-Guided Medical Image Segmentationcited by 0
  22. 2026Text-Guided Medical Image Segmentation via Residual Aggregation and Dense Alignment Representationscited by 0